Apr 12 03:23:40 user devstack@n-api.service[62071]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 03:23:40 user devstack@n-api.service[62071]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 03:23:40 2023] *** Apr 12 03:23:40 user devstack@n-api.service[62071]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 03:23:40 user devstack@n-api.service[62071]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 03:23:40 user devstack@n-api.service[62071]: nodename: user Apr 12 03:23:40 user devstack@n-api.service[62071]: machine: x86_64 Apr 12 03:23:40 user devstack@n-api.service[62071]: clock source: unix Apr 12 03:23:40 user devstack@n-api.service[62071]: pcre jit disabled Apr 12 03:23:40 user devstack@n-api.service[62071]: detected number of CPU cores: 12 Apr 12 03:23:40 user devstack@n-api.service[62071]: current working directory: / Apr 12 03:23:40 user devstack@n-api.service[62071]: detected binary path: /usr/bin/uwsgi-core Apr 12 03:23:40 user devstack@n-api.service[62071]: your processes number limit is 63637 Apr 12 03:23:40 user devstack@n-api.service[62071]: your memory page size is 4096 bytes Apr 12 03:23:40 user devstack@n-api.service[62071]: detected max file descriptor number: 2048 Apr 12 03:23:40 user devstack@n-api.service[62071]: lock engine: pthread robust mutexes Apr 12 03:23:40 user devstack@n-api.service[62071]: thunder lock: enabled Apr 12 03:23:40 user devstack@n-api.service[62071]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 03:23:40 user devstack@n-api.service[62071]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 03:23:41 user devstack@n-api.service[62071]: Python main interpreter initialized at 0x55ed4ebf6990 Apr 12 03:23:41 user devstack@n-api.service[62071]: python threads support enabled Apr 12 03:23:41 user devstack@n-api.service[62071]: your server socket listen backlog is limited to 100 connections Apr 12 03:23:41 user devstack@n-api.service[62071]: your mercy for graceful operations on workers is 90 seconds Apr 12 03:23:41 user devstack@n-api.service[62071]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 03:23:41 user devstack@n-api.service[62071]: *** Operational MODE: preforking *** Apr 12 03:23:41 user devstack@n-api.service[62071]: *** uWSGI is running in multiple interpreter mode *** Apr 12 03:23:41 user devstack@n-api.service[62071]: spawned uWSGI master process (pid: 62071) Apr 12 03:23:41 user devstack@n-api.service[62071]: spawned uWSGI worker 1 (pid: 62072, cores: 1) Apr 12 03:23:41 user devstack@n-api.service[62071]: spawned uWSGI worker 2 (pid: 62073, cores: 1) Apr 12 03:23:41 user devstack@n-api.service[62071]: spawned uWSGI worker 3 (pid: 62074, cores: 1) Apr 12 03:23:41 user devstack@n-api.service[62071]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 03:23:41 user devstack@n-api.service[62072]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 03:23:41 user devstack@n-api.service[62074]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 03:23:41 user devstack@n-api.service[62073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 03:23:45 user devstack@n-api.service[62073]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 03:23:45 user devstack@n-api.service[62073]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 03:23:45 user devstack@n-api.service[62073]: and ``live_migration_inbound_addr`` respectively. Apr 12 03:23:45 user devstack@n-api.service[62073]: ). Its value may be silently ignored in the future. Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 03:23:45 user devstack@n-api.service[62074]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 03:23:45 user devstack@n-api.service[62074]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 03:23:45 user devstack@n-api.service[62074]: and ``live_migration_inbound_addr`` respectively. Apr 12 03:23:45 user devstack@n-api.service[62074]: ). Its value may be silently ignored in the future. Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 03:23:45 user devstack@n-api.service[62072]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 03:23:45 user devstack@n-api.service[62072]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 03:23:45 user devstack@n-api.service[62072]: and ``live_migration_inbound_addr`` respectively. Apr 12 03:23:45 user devstack@n-api.service[62072]: ). Its value may be silently ignored in the future. Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62073) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62074) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62072) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 03:23:45 user devstack@n-api.service[62073]: INFO dbcounter [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Registered counter for database nova_api Apr 12 03:23:45 user devstack@n-api.service[62074]: INFO dbcounter [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Registered counter for database nova_api Apr 12 03:23:45 user devstack@n-api.service[62072]: INFO dbcounter [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Registered counter for database nova_api Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_db.sqlalchemy.engines [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62073) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writer thread running {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_db.sqlalchemy.engines [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62074) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_db.sqlalchemy.engines [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62072) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writer thread running {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writer thread running {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG nova.context [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3401a5-2c95-4968-95ab-b3db72009879(cell1) {{(pid=62073) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG nova.context [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3401a5-2c95-4968-95ab-b3db72009879(cell1) {{(pid=62074) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG nova.context [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d3401a5-2c95-4968-95ab-b3db72009879(cell1) {{(pid=62072) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:23:45 user devstack@n-api.service[62073]: INFO dbcounter [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Registered counter for database nova_cell0 Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:23:45 user devstack@n-api.service[62073]: INFO dbcounter [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Registered counter for database nova_cell1 Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:23:45 user devstack@n-api.service[62074]: INFO dbcounter [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Registered counter for database nova_cell0 Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:23:45 user devstack@n-api.service[62074]: INFO dbcounter [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Registered counter for database nova_cell1 Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_db.sqlalchemy.engines [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62073) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: INFO dbcounter [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Registered counter for database nova_cell0 Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_db.sqlalchemy.engines [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62073) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: INFO dbcounter [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Registered counter for database nova_cell1 Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writer thread running {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_db.sqlalchemy.engines [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62074) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writer thread running {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writer thread running {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_db.sqlalchemy.engines [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62074) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_db.sqlalchemy.engines [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62072) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writer thread running {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_db.sqlalchemy.engines [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62072) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writer thread running {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62073]: INFO dbcounter [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Registered counter for database nova_cell0 Apr 12 03:23:45 user devstack@n-api.service[62074]: INFO dbcounter [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Registered counter for database nova_cell0 Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG oslo_db.sqlalchemy.engines [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62073) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writer thread running {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writer thread running {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG oslo_db.sqlalchemy.engines [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62074) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writer thread running {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:45 user devstack@n-api.service[62072]: INFO dbcounter [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Registered counter for database nova_cell0 Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG oslo_db.sqlalchemy.engines [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62072) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 03:23:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writer thread running {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 03:23:46 user devstack@n-api.service[62073]: WARNING keystonemiddleware.auth_token [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 03:23:46 user devstack@n-api.service[62074]: WARNING keystonemiddleware.auth_token [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 03:23:46 user devstack@n-api.service[62073]: WARNING keystonemiddleware.auth_token [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 03:23:46 user devstack@n-api.service[62074]: WARNING keystonemiddleware.auth_token [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 03:23:46 user devstack@n-api.service[62072]: WARNING keystonemiddleware.auth_token [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 03:23:46 user devstack@n-api.service[62072]: WARNING keystonemiddleware.auth_token [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 03:23:46 user devstack@n-api.service[62073]: WARNING keystonemiddleware.auth_token [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 03:23:46 user devstack@n-api.service[62074]: WARNING keystonemiddleware.auth_token [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 03:23:46 user devstack@n-api.service[62073]: WARNING keystonemiddleware.auth_token [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 03:23:46 user devstack@n-api.service[62074]: WARNING keystonemiddleware.auth_token [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 03:23:46 user devstack@n-api.service[62074]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed4ebf6990 pid: 62074 (default app) Apr 12 03:23:46 user devstack@n-api.service[62073]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed4ebf6990 pid: 62073 (default app) Apr 12 03:23:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:23:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c58acb83-7881-4eaf-aaaf-f7899703cd2b None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001496 Apr 12 03:23:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 03:23:46 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:23:46 user devstack@n-api.service[62072]: WARNING keystonemiddleware.auth_token [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 03:23:46 user devstack@n-api.service[62072]: WARNING keystonemiddleware.auth_token [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 03:23:46 user devstack@n-api.service[62072]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed4ebf6990 pid: 62072 (default app) Apr 12 03:25:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:25:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bb38af06-dba4-4811-97d0-2a0e3176e1f5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002323 Apr 12 03:25:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 1/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:25:54 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:25:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6f59f7a4-f489-4011-941a-a779c25ace2f admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:25:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6f59f7a4-f489-4011-941a-a779c25ace2f admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.386828 Apr 12 03:25:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 2/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 03:25:54 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:25:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:25:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.005702 Apr 12 03:25:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:25:56 2023] GET /compute/v2.1 => generated 387 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:25:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:25:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-33a2c381-9d43-4da1-a840-b36f9b986449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:25:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-33a2c381-9d43-4da1-a840-b36f9b986449 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.314532 Apr 12 03:25:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 2/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:25:56 2023] POST /compute/v2.1/flavors => generated 405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:25:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c74f6bd9-1bec-4325-acee-99f62ef2756b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:25:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c74f6bd9-1bec-4325-acee-99f62ef2756b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047217 Apr 12 03:25:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 3/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 03:25:57 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:25:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:25:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001307 Apr 12 03:25:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:25:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:25:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-32a564db-28c8-483a-ab82-cd074948319d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "name": "ds512M"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:25:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-32a564db-28c8-483a-ab82-cd074948319d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073082 Apr 12 03:25:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 3/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:25:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:25:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3f252415-2ba8-44c3-8f09-c9141e802876 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:25:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3f252415-2ba8-44c3-8f09-c9141e802876 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029120 Apr 12 03:25:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 4/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 03:25:59 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001267 Apr 12 03:26:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0ecd9206-847d-4e6c-9960-5006b406e090 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0ecd9206-847d-4e6c-9960-5006b406e090 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062820 Apr 12 03:26:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 4/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:01 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-97e82f73-0d41-458e-9338-4d498513ba91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-97e82f73-0d41-458e-9338-4d498513ba91 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023709 Apr 12 03:26:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 5/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 03:26:01 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001331 Apr 12 03:26:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cf169fd0-7048-4c18-b5a3-3f627d387803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cf169fd0-7048-4c18-b5a3-3f627d387803 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062906 Apr 12 03:26:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 5/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-70fd4924-b798-4607-a605-984e5b121fa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-70fd4924-b798-4607-a605-984e5b121fa8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024799 Apr 12 03:26:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 6/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 03:26:03 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001276 Apr 12 03:26:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:05 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d64bec35-e413-47f9-bbcd-72b388e69855 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d64bec35-e413-47f9-bbcd-72b388e69855 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062942 Apr 12 03:26:05 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 6/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:05 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025607 Apr 12 03:26:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 7/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 03:26:05 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-eb471e1a-a01c-4dc8-8c1b-32a09e31d818 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002380 Apr 12 03:26:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:07 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-67e5564c-054c-4207-9a98-ccf681de1fea admin admin] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-67e5564c-054c-4207-9a98-ccf681de1fea admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.083129 Apr 12 03:26:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 7/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 03:26:07 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:26:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001734 Apr 12 03:26:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 8/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:26:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:26:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:26:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:26:09 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c86f26f4-abdc-4456-b5f4-f1595f46af5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "vcpus": 1, "disk": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c86f26f4-abdc-4456-b5f4-f1595f46af5a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.377072 Apr 12 03:26:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:09 2023] POST /compute/v2.1/flavors => generated 400 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0be9742c-3027-4476-9742-ca45c3fe5f07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0be9742c-3027-4476-9742-ca45c3fe5f07 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057777 Apr 12 03:26:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 8/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 03:26:09 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001603 Apr 12 03:26:11 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 9/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9de96d2f-3ae1-4c95-85c2-ebe17c21dfac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "id": "2", "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9de96d2f-3ae1-4c95-85c2-ebe17c21dfac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064996 Apr 12 03:26:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:11 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 03:26:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a8ff7b5a-ba15-4579-b625-38ea18d9da35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a8ff7b5a-ba15-4579-b625-38ea18d9da35 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026819 Apr 12 03:26:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 9/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 03:26:11 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001725 Apr 12 03:26:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 10/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:13 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-50c4f4ea-a82c-4485-8070-cb5232824f8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-50c4f4ea-a82c-4485-8070-cb5232824f8f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068155 Apr 12 03:26:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:13 2023] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0c5e4e4c-15ed-4620-ac6f-9483d0a5650d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0c5e4e4c-15ed-4620-ac6f-9483d0a5650d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025570 Apr 12 03:26:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 10/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 03:26:13 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002010 Apr 12 03:26:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 11/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ad3b7a69-3c1e-43a0-b0f3-cb315eab7f5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ad3b7a69-3c1e-43a0-b0f3-cb315eab7f5c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.065635 Apr 12 03:26:15 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:15 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:15 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c3014276-4556-4e45-96d9-3e4f30a0fed4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c3014276-4556-4e45-96d9-3e4f30a0fed4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023672 Apr 12 03:26:15 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 11/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 03:26:15 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:17 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001626 Apr 12 03:26:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 12/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 03:26:17 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:17 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9d8e0b0c-e981-40b2-8f6f-701462f1e77e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:17 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9d8e0b0c-e981-40b2-8f6f-701462f1e77e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062350 Apr 12 03:26:17 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 03:26:17 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:26:17 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8d4e14ff-07fe-4828-a740-4796d63edfe5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:26:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8d4e14ff-07fe-4828-a740-4796d63edfe5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023697 Apr 12 03:26:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 12/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 03:26:17 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:26:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-066600f9-832b-416d-b9c2-d2f3827bb1c2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001616 Apr 12 03:26:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 13/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 03:26:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:26:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:26:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.090198 Apr 12 03:26:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 03:26:50 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:27:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8d4e14ff-07fe-4828-a740-4796d63edfe5 admin admin] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:27:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8d4e14ff-07fe-4828-a740-4796d63edfe5 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001524 Apr 12 03:27:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 13/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 03:27:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:27:21 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:27:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-957738c0-f951-4fcb-9580-d345e52d478e admin admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:27:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-957738c0-f951-4fcb-9580-d345e52d478e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.071958 Apr 12 03:27:21 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 14/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 03:27:21 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:27:26 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:27:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001767 Apr 12 03:27:26 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 03:27:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:27:26 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:27:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-1a30c815-64dd-421c-aa7d-fc7fb6b4374e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "vcpus": 1, "name": "m1.nano", "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:27:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-1a30c815-64dd-421c-aa7d-fc7fb6b4374e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063246 Apr 12 03:27:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 14/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 03:27:26 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:27:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8f03fbbc-6921-4879-8907-c530ee0632fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:27:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8f03fbbc-6921-4879-8907-c530ee0632fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026527 Apr 12 03:27:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 15/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 03:27:26 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:27:30 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:27:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c4500864-539a-4b2e-90ca-db4716dc49ac admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001733 Apr 12 03:27:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 03:27:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:27:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-fd49bab1-b220-4970-b210-228456315580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "m1.micro", "swap": 0, "vcpus": 1, "ram": 192, "rxtx_factor": 1.0, "id": "84", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:27:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-fd49bab1-b220-4970-b210-228456315580 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071676 Apr 12 03:27:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 15/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 03:27:30 2023] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:27:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-741cd529-03dd-4cc5-af24-0d2e2f4e2b18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:27:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-741cd529-03dd-4cc5-af24-0d2e2f4e2b18 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027723 Apr 12 03:27:30 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 16/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 03:27:30 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:29:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:29:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:29:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:29:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-6799d594-60bb-4595-ad6f-71086e8f042c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'create', calling method: .version_select at 0x7f76a7aa2950>, body: {"keypair": {"name": "tempest-keypair-892402082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNv3aMnfqZBrraTWMhLhVcBPnIqd/pyo9633J0szzOpRjklWBRcLk+TXv631ENNLeAHi6cKzIvn2qCEpBSN9HX63yWj5klT0kBwkXMpaNwu0eHxsmOThEKjvkK+5wRQIg=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:29:59 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-6799d594-60bb-4595-ad6f-71086e8f042c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:29:59 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-6799d594-60bb-4595-ad6f-71086e8f042c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for user de1fe5db01624224ab7b615c908d990b and project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:00 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-6799d594-60bb-4595-ad6f-71086e8f042c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.246499 Apr 12 03:30:00 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 15/46] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 03:29:59 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 12 03:30:06 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:06 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2007129702", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "1a483654-b740-4544-84c9-53a41c11fa88"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1115900831", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265"}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-65f2fe67-2bde-412c-b05a-bbb0019d6aa3 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Action: 'create', calling method: .version_select at 0x7f76a79235b0>, body: {"keypair": {"name": "tempest-keypair-31851495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInWJADLpni9D9TfgnC1+/LMPrrQuD/lxuqixLR+mL8FYE3064UBREFALqAw20h2nHoOSsmv2cMRVuFj3Oi+UewdLxZXOi4pdekw/Cvt3tr0uQWDcvZgNGpzrP2V/qty5w=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:07 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-65f2fe67-2bde-412c-b05a-bbb0019d6aa3 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Getting quotas for project a027d7708e6747fe970c388d6ba66359. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:07 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-65f2fe67-2bde-412c-b05a-bbb0019d6aa3 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Getting quotas for user 9405e57e55e84976b0caeba84e3aef62 and project a027d7708e6747fe970c388d6ba66359. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-65f2fe67-2bde-412c-b05a-bbb0019d6aa3 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.304800 Apr 12 03:30:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:30:06 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:30:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1925048093", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "638ee582-4cac-44e7-b703-386f5116e8a3"}], "security_groups": [{"name": "tempest-securitygroup--1282105666"}], "key_name": "tempest-keypair-892402082", "user_data": "}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:07 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] validate_networks() for [('1a483654-b740-4544-84c9-53a41c11fa88', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:07 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] validate_networks() for [('f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:07 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] validate_networks() for [('638ee582-4cac-44e7-b703-386f5116e8a3', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Getting quotas for project 83a7ef3f97fd47849973d4e4482fb5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Getting quotas for user 3da7394c51664a7caacfda6b7dda9066 and project 83a7ef3f97fd47849973d4e4482fb5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:08 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-319c1db8-7f15-4946-915d-e5b93087ab2c tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.156078 Apr 12 03:30:08 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 17/48] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:30:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a0679ba5-4d48-4596-a98b-1b41610aa65e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:08 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a0679ba5-4d48-4596-a98b-1b41610aa65e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:09 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a0679ba5-4d48-4596-a98b-1b41610aa65e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a0679ba5-4d48-4596-a98b-1b41610aa65e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1211 microversion: 2.1 time: 0.189268 Apr 12 03:30:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:08 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for user d99be569057f432484e4a60b46882bbd and project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-147a25b6-0562-44dc-96f7-722a986a50b7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 3.139139 Apr 12 03:30:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 16/50] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:30:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 3142 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-470d1f2f-4035-4f39-a3df-c5b41d13a459 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:09 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-470d1f2f-4035-4f39-a3df-c5b41d13a459 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for user de1fe5db01624224ab7b615c908d990b and project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:09 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-470d1f2f-4035-4f39-a3df-c5b41d13a459 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:09 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-470d1f2f-4035-4f39-a3df-c5b41d13a459 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:09 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-470d1f2f-4035-4f39-a3df-c5b41d13a459 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-0cacaa5c-1afc-4a2a-aa98-992205d778f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.600520 Apr 12 03:30:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 17/51] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:30:07 2023] POST /compute/v2.1/servers => generated 400 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:30:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-470d1f2f-4035-4f39-a3df-c5b41d13a459 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5" status: 200 len: 1395 microversion: 2.87 time: 0.196443 Apr 12 03:30:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 19/52] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:30:09 2023] GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 => generated 1395 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3281c399-6bdb-4f49-aa26-21868fc7cf0b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3281c399-6bdb-4f49-aa26-21868fc7cf0b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:10 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-3281c399-6bdb-4f49-aa26-21868fc7cf0b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:10 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-3281c399-6bdb-4f49-aa26-21868fc7cf0b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:10 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-3281c399-6bdb-4f49-aa26-21868fc7cf0b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3281c399-6bdb-4f49-aa26-21868fc7cf0b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1275 microversion: 2.20 time: 0.189801 Apr 12 03:30:10 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 17/53] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:30:09 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:30:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-160677355", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "0f8e4d8d-8d90-47de-a965-5610331236ef"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:11 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] validate_networks() for [('0f8e4d8d-8d90-47de-a965-5610331236ef', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:12 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-252473144", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "b4464ad0-6022-43e7-bfe4-229e6a3a0600"}], "security_groups": [{"name": "tempest-securitygroup--1236702295"}], "key_name": "tempest-keypair-31851495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:13 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] validate_networks() for [('b4464ad0-6022-43e7-bfe4-229e6a3a0600', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Getting quotas for project 5dadbf1b0a124d2d929c85bc2b916022. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Getting quotas for user 4d01e7aaa3734b299d0c0a27844011b4 and project 5dadbf1b0a124d2d929c85bc2b916022. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-14b21ce6-cc29-420a-bf78-0b1b8db41ecd tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.072241 Apr 12 03:30:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:30:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:30:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d99ebf0f-95fb-4a2a-82dc-382a3987f8a7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:13 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d99ebf0f-95fb-4a2a-82dc-382a3987f8a7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:13 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-d99ebf0f-95fb-4a2a-82dc-382a3987f8a7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d01e7aaa3734b299d0c0a27844011b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dadbf1b0a124d2d929c85bc2b916022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d99ebf0f-95fb-4a2a-82dc-382a3987f8a7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 200 len: 1208 microversion: 2.1 time: 0.326576 Apr 12 03:30:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:13 2023] GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 1208 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Getting quotas for project a027d7708e6747fe970c388d6ba66359. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Getting quotas for user 9405e57e55e84976b0caeba84e3aef62 and project a027d7708e6747fe970c388d6ba66359. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:14 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2210a820-7536-4aef-aa56-42e3c1adef9f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.304540 Apr 12 03:30:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:30:12 2023] POST /compute/v2.1/servers => generated 404 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:30:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d21a5084-dc1a-4155-8f61-a221b8c062e5 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:15 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d21a5084-dc1a-4155-8f61-a221b8c062e5 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:15 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d21a5084-dc1a-4155-8f61-a221b8c062e5 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d21a5084-dc1a-4155-8f61-a221b8c062e5 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1237 microversion: 2.1 time: 0.173189 Apr 12 03:30:15 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:15 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1237 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:30:16 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56834002-7593-4592-a86d-23bb90d00be0", "tag": "8f7b221a-25ae-41f9-847d-5aedf2d93a71"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Creating event network-changed:8f7b221a-25ae-41f9-847d-5aedf2d93a71 for instance 56834002-7593-4592-a86d-23bb90d00be0 on user Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62073) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a39c0f44-c26b-4321-a864-af64109dddf7 req-fabc03ee-de16-4b1a-8403-d30de0f9e35a service nova] Acquired lock "compute-rpcapi-router" {{(pid=62073) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:17 user devstack@n-api.service[62073]: INFO nova.compute.rpcapi [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 03:30:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] Releasing lock "compute-rpcapi-router" {{(pid=62073) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 03:30:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8d33c20e-7974-4a11-a2e8-8ffd05b22ff2 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309051 Apr 12 03:30:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 19/58] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d0904c3-74e0-47bb-a832-758a7035b2f5", "tag": "dce84390-a2f8-4047-b513-eec5845a2399"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:18 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Creating event network-changed:dce84390-a2f8-4047-b513-eec5845a2399 for instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 on user Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62074) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-417d7450-cc07-4705-a961-1463dc760052 req-7cb75786-2d82-44ec-ba73-9b3c838e2c57 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62074) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:18 user devstack@n-api.service[62074]: INFO nova.compute.rpcapi [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 03:30:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] Releasing lock "compute-rpcapi-router" {{(pid=62074) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 03:30:18 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a22a5f24-8134-45eb-9184-02b267270ee1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193033 Apr 12 03:30:18 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Creating event network-changed:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62072) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c1f7106-37b9-46d3-bc78-37014ea1c0a6 req-8349ec48-3f1c-45d6-8c69-5576d270c4b9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62072) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:22 user devstack@n-api.service[62072]: INFO nova.compute.rpcapi [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 03:30:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=62072) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 03:30:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-30bd345a-4ff5-4524-b45a-be72c58ce9d5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369013 Apr 12 03:30:22 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:23 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=10 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:23 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d53f0fe1-d6ea-4e8a-b8bc-884c8ea1c4e5 req-6a5c0af7-9c31-461d-b352-20b80fb3b3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0904c3-74e0-47bb-a832-758a7035b2f5", "name": "network-vif-plugged", "status": "completed", "tag": "dce84390-a2f8-4047-b513-eec5845a2399"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d53f0fe1-d6ea-4e8a-b8bc-884c8ea1c4e5 req-6a5c0af7-9c31-461d-b352-20b80fb3b3c5 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d53f0fe1-d6ea-4e8a-b8bc-884c8ea1c4e5 req-6a5c0af7-9c31-461d-b352-20b80fb3b3c5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d53f0fe1-d6ea-4e8a-b8bc-884c8ea1c4e5 req-6a5c0af7-9c31-461d-b352-20b80fb3b3c5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d53f0fe1-d6ea-4e8a-b8bc-884c8ea1c4e5 req-6a5c0af7-9c31-461d-b352-20b80fb3b3c5 service nova] Creating event network-vif-plugged:dce84390-a2f8-4047-b513-eec5845a2399 for instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 on user Apr 12 03:30:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d53f0fe1-d6ea-4e8a-b8bc-884c8ea1c4e5 req-6a5c0af7-9c31-461d-b352-20b80fb3b3c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051295 Apr 12 03:30:23 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:30:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-4a2e4b53-2ab1-4294-89d9-a5f7970f130c req-bd0d1c92-0410-467f-904f-f13a38b80d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef4ab4cb-6164-47ea-be1d-cbe0698f991d", "tag": "cc0a860c-4dc1-4a09-836a-3878bcb30d40"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4a2e4b53-2ab1-4294-89d9-a5f7970f130c req-bd0d1c92-0410-467f-904f-f13a38b80d29 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4a2e4b53-2ab1-4294-89d9-a5f7970f130c req-bd0d1c92-0410-467f-904f-f13a38b80d29 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4a2e4b53-2ab1-4294-89d9-a5f7970f130c req-bd0d1c92-0410-467f-904f-f13a38b80d29 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-4a2e4b53-2ab1-4294-89d9-a5f7970f130c req-bd0d1c92-0410-467f-904f-f13a38b80d29 service nova] Creating event network-changed:cc0a860c-4dc1-4a09-836a-3878bcb30d40 for instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d on user Apr 12 03:30:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-4a2e4b53-2ab1-4294-89d9-a5f7970f130c req-bd0d1c92-0410-467f-904f-f13a38b80d29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070475 Apr 12 03:30:24 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 22/62] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:25 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=22 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:26 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0904c3-74e0-47bb-a832-758a7035b2f5", "name": "network-vif-plugged", "status": "completed", "tag": "dce84390-a2f8-4047-b513-eec5845a2399"}, {"server_uuid": "56834002-7593-4592-a86d-23bb90d00be0", "name": "network-vif-plugged", "status": "completed", "tag": "8f7b221a-25ae-41f9-847d-5aedf2d93a71"}, {"server_uuid": "56834002-7593-4592-a86d-23bb90d00be0", "name": "network-vif-plugged", "status": "completed", "tag": "8f7b221a-25ae-41f9-847d-5aedf2d93a71"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Creating event network-vif-plugged:dce84390-a2f8-4047-b513-eec5845a2399 for instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 on user Apr 12 03:30:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Creating event network-vif-plugged:8f7b221a-25ae-41f9-847d-5aedf2d93a71 for instance 56834002-7593-4592-a86d-23bb90d00be0 on user Apr 12 03:30:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] Creating event network-vif-plugged:8f7b221a-25ae-41f9-847d-5aedf2d93a71 for instance 56834002-7593-4592-a86d-23bb90d00be0 on user Apr 12 03:30:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-cd5fdf31-7a62-4a03-95ce-8f39583592ef req-8258b9c9-f691-40fe-baa3-ef3ac6cd3091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067666 Apr 12 03:30:26 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-fb274ce5-6eac-4815-9d1e-110471e07d28 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Action: 'create', calling method: .version_select at 0x7f76a700eb90>, body: {"keypair": {"name": "tempest-keypair-586254963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL30RSbxjhGUn3xzLsIU4EV60BoTDcVspvaYQIbHfZgYoaBW0uNt/hjufJbiOeYVn8jEh3f2sIF4VJXBBn5+nGUjfajRfTCakLkfoH9ag8vOMyCnoG9vAKKOAoeQq5klzw=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:26 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-fb274ce5-6eac-4815-9d1e-110471e07d28 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Getting quotas for project f51faa215a1546fbaa0db25c9773ba6f. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:26 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-fb274ce5-6eac-4815-9d1e-110471e07d28 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Getting quotas for user 09fd9f0996bd48628564e6c170c11a17 and project f51faa215a1546fbaa0db25c9773ba6f. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-fb274ce5-6eac-4815-9d1e-110471e07d28 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127167 Apr 12 03:30:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:30:26 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:26 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=16 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c3a77492-e32a-4d27-a528-3c115f29ccbd req-7ccc0352-0c6b-471b-9a86-e762ef703774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c3a77492-e32a-4d27-a528-3c115f29ccbd req-7ccc0352-0c6b-471b-9a86-e762ef703774 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c3a77492-e32a-4d27-a528-3c115f29ccbd req-7ccc0352-0c6b-471b-9a86-e762ef703774 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c3a77492-e32a-4d27-a528-3c115f29ccbd req-7ccc0352-0c6b-471b-9a86-e762ef703774 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c3a77492-e32a-4d27-a528-3c115f29ccbd req-7ccc0352-0c6b-471b-9a86-e762ef703774 service nova] Creating event network-changed:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:30:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c3a77492-e32a-4d27-a528-3c115f29ccbd req-7ccc0352-0c6b-471b-9a86-e762ef703774 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068862 Apr 12 03:30:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 23/65] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:28 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-8c55728e-67d6-43ea-b124-8b7087fe7a32 req-ecc91852-c79e-4b44-9bc9-0004d89071e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-plugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c55728e-67d6-43ea-b124-8b7087fe7a32 req-ecc91852-c79e-4b44-9bc9-0004d89071e9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c55728e-67d6-43ea-b124-8b7087fe7a32 req-ecc91852-c79e-4b44-9bc9-0004d89071e9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c55728e-67d6-43ea-b124-8b7087fe7a32 req-ecc91852-c79e-4b44-9bc9-0004d89071e9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-8c55728e-67d6-43ea-b124-8b7087fe7a32 req-ecc91852-c79e-4b44-9bc9-0004d89071e9 service nova] Creating event network-vif-plugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:30:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-8c55728e-67d6-43ea-b124-8b7087fe7a32 req-ecc91852-c79e-4b44-9bc9-0004d89071e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084754 Apr 12 03:30:28 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:29 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:29 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-571161248", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "554fd203-5ff6-4282-87b1-d27aa5dba9e3"}], "security_groups": [{"name": "tempest-securitygroup--876659690"}], "key_name": "tempest-keypair-586254963", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:29 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] validate_networks() for [('554fd203-5ff6-4282-87b1-d27aa5dba9e3', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-plugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}, {"server_uuid": "ef4ab4cb-6164-47ea-be1d-cbe0698f991d", "name": "network-vif-plugged", "status": "completed", "tag": "cc0a860c-4dc1-4a09-836a-3878bcb30d40"}, {"server_uuid": "ef4ab4cb-6164-47ea-be1d-cbe0698f991d", "name": "network-vif-plugged", "status": "completed", "tag": "cc0a860c-4dc1-4a09-836a-3878bcb30d40"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:30 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Creating event network-vif-plugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:30:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Creating event network-vif-plugged:cc0a860c-4dc1-4a09-836a-3878bcb30d40 for instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d on user Apr 12 03:30:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] Creating event network-vif-plugged:cc0a860c-4dc1-4a09-836a-3878bcb30d40 for instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d on user Apr 12 03:30:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-00831d95-64a8-4927-8e74-1c9ad6fa2348 req-9d0d6729-0348-4db2-ae4c-d8a2f0c74179 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.086831 Apr 12 03:30:30 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 24/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:30 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b71b81e1-dda9-405f-aa9a-579c9a356d67 req-277663ce-3c96-420f-904a-31167962302b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:30 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b71b81e1-dda9-405f-aa9a-579c9a356d67 req-277663ce-3c96-420f-904a-31167962302b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b71b81e1-dda9-405f-aa9a-579c9a356d67 req-277663ce-3c96-420f-904a-31167962302b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b71b81e1-dda9-405f-aa9a-579c9a356d67 req-277663ce-3c96-420f-904a-31167962302b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:30 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=13 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b71b81e1-dda9-405f-aa9a-579c9a356d67 req-277663ce-3c96-420f-904a-31167962302b service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:30:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b71b81e1-dda9-405f-aa9a-579c9a356d67 req-277663ce-3c96-420f-904a-31167962302b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060041 Apr 12 03:30:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Getting quotas for project f51faa215a1546fbaa0db25c9773ba6f. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Getting quotas for user 09fd9f0996bd48628564e6c170c11a17 and project f51faa215a1546fbaa0db25c9773ba6f. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0e07b2ee-3fc5-48da-810e-0e431e971682 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.979642 Apr 12 03:30:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 22/69] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:30:29 2023] POST /compute/v2.1/servers => generated 403 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:30:31 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-cd7c7879-f1ec-466a-891f-950df3720168 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:31 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-cd7c7879-f1ec-466a-891f-950df3720168 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:31 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-cd7c7879-f1ec-466a-891f-950df3720168 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fd9f0996bd48628564e6c170c11a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51faa215a1546fbaa0db25c9773ba6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:31 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-cd7c7879-f1ec-466a-891f-950df3720168 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7" status: 200 len: 1224 microversion: 2.1 time: 0.127722 Apr 12 03:30:31 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 25/70] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:31 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:30:32 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:32 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-df41b090-db7d-4f7f-892a-1a5db647e49b req-fc00a419-1059-4a7b-97a1-de01b4d689fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-df41b090-db7d-4f7f-892a-1a5db647e49b req-fc00a419-1059-4a7b-97a1-de01b4d689fd service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-df41b090-db7d-4f7f-892a-1a5db647e49b req-fc00a419-1059-4a7b-97a1-de01b4d689fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-df41b090-db7d-4f7f-892a-1a5db647e49b req-fc00a419-1059-4a7b-97a1-de01b4d689fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-df41b090-db7d-4f7f-892a-1a5db647e49b req-fc00a419-1059-4a7b-97a1-de01b4d689fd service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:30:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-df41b090-db7d-4f7f-892a-1a5db647e49b req-fc00a419-1059-4a7b-97a1-de01b4d689fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087316 Apr 12 03:30:32 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b75b0145-8f5b-4e1e-974f-42dcd276ab1a tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Action: 'create', calling method: .version_select at 0x7f76a7044820>, body: {"keypair": {"name": "tempest-keypair-539207312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW7Yrpu5SOQ/b67vmyb/sqyksJOlf4MPK63MIfzlSnm+OH9BJ8Yy9IStENYg+9gKakI2VPnKTMAt5l9nxKRjD2o/A0rxASwuMLoI7j1zUAFxuHzukBR9RVxm++z5vy2Ww=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:33 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b75b0145-8f5b-4e1e-974f-42dcd276ab1a tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Getting quotas for project 90a92643aee44b66864aa10c2cf6f048. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:33 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b75b0145-8f5b-4e1e-974f-42dcd276ab1a tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Getting quotas for user 431c372c4da24fa692f43f2d16764755 and project 90a92643aee44b66864aa10c2cf6f048. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b75b0145-8f5b-4e1e-974f-42dcd276ab1a tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.532993 Apr 12 03:30:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:30:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1054497631", "imageRef": "6aba2abf-651e-4da7-9a27-c2c991cb5c61", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "01db77fb-7cb3-4eb1-b9d4-9ce9a671b333"}], "security_groups": [{"name": "tempest-securitygroup--1456058674"}], "key_name": "tempest-keypair-539207312", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:35 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] validate_networks() for [('01db77fb-7cb3-4eb1-b9d4-9ce9a671b333', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Getting quotas for project 90a92643aee44b66864aa10c2cf6f048. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Getting quotas for user 431c372c4da24fa692f43f2d16764755 and project 90a92643aee44b66864aa10c2cf6f048. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:36 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6aba2abf-651e-4da7-9a27-c2c991cb5c61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:36 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-e5ab2d91-27cb-4d73-8f46-08013891cc41 req-fb3fbe28-3e8a-4bc1-895d-c63f0eaaa361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e5ab2d91-27cb-4d73-8f46-08013891cc41 req-fb3fbe28-3e8a-4bc1-895d-c63f0eaaa361 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e5ab2d91-27cb-4d73-8f46-08013891cc41 req-fb3fbe28-3e8a-4bc1-895d-c63f0eaaa361 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e5ab2d91-27cb-4d73-8f46-08013891cc41 req-fb3fbe28-3e8a-4bc1-895d-c63f0eaaa361 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:36 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=13 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:36 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e5ab2d91-27cb-4d73-8f46-08013891cc41 req-fb3fbe28-3e8a-4bc1-895d-c63f0eaaa361 service nova] Creating event network-changed:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:30:36 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-e5ab2d91-27cb-4d73-8f46-08013891cc41 req-fb3fbe28-3e8a-4bc1-895d-c63f0eaaa361 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041535 Apr 12 03:30:36 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:36 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1f0d8c91-b183-4533-9dfa-b4ea54f1d540 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.868393 Apr 12 03:30:36 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 26/74] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:30:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:30:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-af988803-cd72-4fec-b63f-c1abaef90659 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:36 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-af988803-cd72-4fec-b63f-c1abaef90659 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:36 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-af988803-cd72-4fec-b63f-c1abaef90659 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431c372c4da24fa692f43f2d16764755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a92643aee44b66864aa10c2cf6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-af988803-cd72-4fec-b63f-c1abaef90659 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 200 len: 1239 microversion: 2.1 time: 0.134121 Apr 12 03:30:36 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 25/75] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:36 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 1239 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:30:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-ea68aaf2-0804-4b77-baee-73d5d4acd7fc req-da13d549-a89e-49bd-b56e-22eb06493534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "name": "network-vif-plugged", "status": "completed", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ea68aaf2-0804-4b77-baee-73d5d4acd7fc req-da13d549-a89e-49bd-b56e-22eb06493534 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ea68aaf2-0804-4b77-baee-73d5d4acd7fc req-da13d549-a89e-49bd-b56e-22eb06493534 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ea68aaf2-0804-4b77-baee-73d5d4acd7fc req-da13d549-a89e-49bd-b56e-22eb06493534 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ea68aaf2-0804-4b77-baee-73d5d4acd7fc req-da13d549-a89e-49bd-b56e-22eb06493534 service nova] Creating event network-vif-plugged:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:30:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-ea68aaf2-0804-4b77-baee-73d5d4acd7fc req-da13d549-a89e-49bd-b56e-22eb06493534 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052494 Apr 12 03:30:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "name": "network-vif-plugged", "status": "completed", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}, {"name": "network-changed", "server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:42 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:42 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=17 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] Creating event network-vif-plugged:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:30:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] Creating event network-changed:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:30:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-53f47c4a-46d1-4145-8777-617e6fd8cc70 req-74e19525-f0b1-41aa-be96-b25e1a50e7f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061832 Apr 12 03:30:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:42 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b781b542-5820-466c-b173-5ebe1cabc20b req-1bb605b7-47c8-4eb9-adb1-84ba9cbaee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "name": "network-vif-plugged", "status": "completed", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b781b542-5820-466c-b173-5ebe1cabc20b req-1bb605b7-47c8-4eb9-adb1-84ba9cbaee48 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b781b542-5820-466c-b173-5ebe1cabc20b req-1bb605b7-47c8-4eb9-adb1-84ba9cbaee48 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b781b542-5820-466c-b173-5ebe1cabc20b req-1bb605b7-47c8-4eb9-adb1-84ba9cbaee48 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b781b542-5820-466c-b173-5ebe1cabc20b req-1bb605b7-47c8-4eb9-adb1-84ba9cbaee48 service nova] Creating event network-vif-plugged:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:30:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b781b542-5820-466c-b173-5ebe1cabc20b req-1bb605b7-47c8-4eb9-adb1-84ba9cbaee48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053686 Apr 12 03:30:45 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:48 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:48 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=10 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-03cfd944-93b7-4706-b02e-64560c370632 req-d2262ea9-cb8a-41cd-a353-5065a8ca96a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "name": "network-vif-plugged", "status": "completed", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-03cfd944-93b7-4706-b02e-64560c370632 req-d2262ea9-cb8a-41cd-a353-5065a8ca96a0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-03cfd944-93b7-4706-b02e-64560c370632 req-d2262ea9-cb8a-41cd-a353-5065a8ca96a0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-03cfd944-93b7-4706-b02e-64560c370632 req-d2262ea9-cb8a-41cd-a353-5065a8ca96a0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-03cfd944-93b7-4706-b02e-64560c370632 req-d2262ea9-cb8a-41cd-a353-5065a8ca96a0 service nova] Creating event network-vif-plugged:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:30:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-03cfd944-93b7-4706-b02e-64560c370632 req-d2262ea9-cb8a-41cd-a353-5065a8ca96a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047354 Apr 12 03:30:48 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:30:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:30:52 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:52 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:52 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f2337392-c296-4799-b401-1350750b3d03 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Action: 'create', calling method: .version_select at 0x7f76a79eb2e0>, body: {"keypair": {"name": "tempest-keypair-476892975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS3ZbVHfxQVFHpZS5QTkoqKDiEjmhCdyP6+fgfZz0jwXQ4fAjcP60l9wC1gyScpF8Zw9rmHw2YJpeRpTUHuz2Hroka/B8qwVo0YxuHbLGdfKbP5YGwIEhUARrat7zqI4A=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:52 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-f2337392-c296-4799-b401-1350750b3d03 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Getting quotas for project 72d31bafe182459aa8bcb4f1bbb5e6d0. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:52 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-f2337392-c296-4799-b401-1350750b3d03 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Getting quotas for user e7aeea82653d4681aa22f6dd8ae742b4 and project 72d31bafe182459aa8bcb4f1bbb5e6d0. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:52 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:52 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f2337392-c296-4799-b401-1350750b3d03 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.086053 Apr 12 03:30:52 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 28/80] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 03:30:52 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 03:30:54 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1028113698", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "9ea0ab38-8496-4a4b-a54b-fa36e90fd60a"}, {"port": "835b5a2a-4d35-4d2a-9fdd-0c78b7def163", "tag": "port-1"}, {"port": "a1aaff41-e246-4887-89c6-a91163d4efd5", "tag": "port-2"}, {"uuid": "d4fb95ab-11b5-4eff-b746-035d8a799faa", "tag": "net-1"}, {"uuid": "d4fb95ab-11b5-4eff-b746-035d8a799faa"}, {"uuid": "435f9638-5e8f-40a8-b271-a183982c70d5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "435f9638-5e8f-40a8-b271-a183982c70d5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ba2eb790-6032-4455-82ed-af81c61ca352", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "19d5feb6-1f29-4d61-8901-3b445f0c26fd", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c73ac339-e533-4c8b-958d-ddf3e59dfb7d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--903106263"}], "key_name": "tempest-keypair-476892975", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:54 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] validate_networks() for [('9ea0ab38-8496-4a4b-a54b-fa36e90fd60a', None, None, None, None, None), (None, None, '835b5a2a-4d35-4d2a-9fdd-0c78b7def163', None, None, None), (None, None, 'a1aaff41-e246-4887-89c6-a91163d4efd5', None, None, None), ('d4fb95ab-11b5-4eff-b746-035d8a799faa', None, None, None, None, None), ('d4fb95ab-11b5-4eff-b746-035d8a799faa', None, None, None, None, None), ('435f9638-5e8f-40a8-b271-a183982c70d5', '10.2.2.100', None, None, None, None), ('435f9638-5e8f-40a8-b271-a183982c70d5', '10.2.2.200', None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:55 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b3249081-c3ad-47d1-a8d5-5217aeb3be48 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Action: 'create', calling method: .version_select at 0x7f76a700e440>, body: {"keypair": {"name": "tempest-keypair-2115967448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCyWVMCVeXTj4eZLmBDk3uEr+ohaWpwIv6zTkIlNZ2QRH2THWN8SXei5drq2IJGQkIvQoNzOXVCuGCaf7h5mScjI1xfzmSUsrhlqHzEQ4MwAG4OF6CGlMBmuH+1KctDlA=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:56 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-b3249081-c3ad-47d1-a8d5-5217aeb3be48 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Getting quotas for project bd808e7e237f4c7490abaff5db0e3529. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:56 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-b3249081-c3ad-47d1-a8d5-5217aeb3be48 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Getting quotas for user d29b6ed431d64bcab02c2348feab9aa6 and project bd808e7e237f4c7490abaff5db0e3529. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b3249081-c3ad-47d1-a8d5-5217aeb3be48 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.059227 Apr 12 03:30:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 27/81] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 03:30:55 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1090048845", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "07d0f97b-06f9-40b3-8794-e53924379d25"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] validate_networks() for [('07d0f97b-06f9-40b3-8794-e53924379d25', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Getting quotas for project 72d31bafe182459aa8bcb4f1bbb5e6d0. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Getting quotas for user e7aeea82653d4681aa22f6dd8ae742b4 and project 72d31bafe182459aa8bcb4f1bbb5e6d0. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ba2eb790-6032-4455-82ed-af81c61ca352',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='19d5feb6-1f29-4d61-8901-3b445f0c26fd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c73ac339-e533-4c8b-958d-ddf3e59dfb7d',volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Getting quotas for project 86f7b42b161f41efb234f0ce70210a08. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Getting quotas for user 84ea3a8776a944178ba5a04bce4d9b05 and project 86f7b42b161f41efb234f0ce70210a08. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:30:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:30:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8a09205f-6280-478f-98d9-4e529975a15b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.541058 Apr 12 03:30:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 29/82] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:30:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:30:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f262dbde-cb2d-4900-94c6-7b3ea3c548dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f262dbde-cb2d-4900-94c6-7b3ea3c548dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:56 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f262dbde-cb2d-4900-94c6-7b3ea3c548dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84ea3a8776a944178ba5a04bce4d9b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f7b42b161f41efb234f0ce70210a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f262dbde-cb2d-4900-94c6-7b3ea3c548dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0" status: 200 len: 1213 microversion: 2.1 time: 0.084045 Apr 12 03:30:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:56 2023] GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:30:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b0f2113c-5471-4e87-8770-726a18efa525 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.125249 Apr 12 03:30:57 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 27/84] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 03:30:54 2023] POST /compute/v2.1/servers => generated 403 bytes in 3127 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:30:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3f29fe75-9d83-4e3b-bae6-689c7c6bef80 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:57 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-3f29fe75-9d83-4e3b-bae6-689c7c6bef80 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:57 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-3f29fe75-9d83-4e3b-bae6-689c7c6bef80 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:57 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-3f29fe75-9d83-4e3b-bae6-689c7c6bef80 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:57 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-3f29fe75-9d83-4e3b-bae6-689c7c6bef80 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3f29fe75-9d83-4e3b-bae6-689c7c6bef80 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 200 len: 1279 microversion: 2.42 time: 0.084405 Apr 12 03:30:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 30/85] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:30:57 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:30:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-780207909", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "0905eabd-7263-448c-97f6-296c5b42cd24"}, {"port": "7740f806-8319-484b-8b0f-bffd8c5fe532", "tag": "port-1"}, {"port": "be3de447-6d22-4fec-b962-0ebe772ed86f", "tag": "port-2"}, {"uuid": "6274e1ca-390b-4378-9386-d41818b17cb3", "tag": "net-1"}, {"uuid": "6274e1ca-390b-4378-9386-d41818b17cb3"}, {"uuid": "2767acc3-5e96-41ad-a7f4-fbd5b4acce3a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2767acc3-5e96-41ad-a7f4-fbd5b4acce3a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6a6c8492-c29c-49f6-954b-a9381cd886e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0aea0a9e-658d-4acc-ba07-3ef1bace5eb9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6f5da98e-cf9d-4e7e-b6fb-30a51a803fc3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1677456127"}], "key_name": "tempest-keypair-2115967448", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:30:57 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] validate_networks() for [('0905eabd-7263-448c-97f6-296c5b42cd24', None, None, None, None, None), (None, None, '7740f806-8319-484b-8b0f-bffd8c5fe532', None, None, None), (None, None, 'be3de447-6d22-4fec-b962-0ebe772ed86f', None, None, None), ('6274e1ca-390b-4378-9386-d41818b17cb3', None, None, None, None, None), ('6274e1ca-390b-4378-9386-d41818b17cb3', None, None, None, None, None), ('2767acc3-5e96-41ad-a7f4-fbd5b4acce3a', '10.2.2.100', None, None, None, None), ('2767acc3-5e96-41ad-a7f4-fbd5b4acce3a', '10.2.2.200', None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:30:58 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=5 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:30:59 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:30:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-373a5d37-e6f3-484e-b70e-a7829fada0da tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1494 microversion: 2.1 time: 0.245186 Apr 12 03:30:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 28/86] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:30:59 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1494 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:00 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:00 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-74bb05ed-e09f-4c95-9536-fd618b031d31 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1586 microversion: 2.20 time: 0.223004 Apr 12 03:31:00 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:31:00 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1586 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c139f4fb-1e2c-4575-8dfb-5b144dd286cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5" status: 200 len: 1692 microversion: 2.87 time: 0.606223 Apr 12 03:31:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 31/88] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:30:59 2023] GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 => generated 1692 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:31:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-7ac4f5ea-23c0-4b50-b125-a98271eb666b req-0ebda4ba-8919-49cd-b01c-7c120a8b11a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0", "tag": "91c0bcc3-17a9-4444-bb3c-715e45188260"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7ac4f5ea-23c0-4b50-b125-a98271eb666b req-0ebda4ba-8919-49cd-b01c-7c120a8b11a6 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7ac4f5ea-23c0-4b50-b125-a98271eb666b req-0ebda4ba-8919-49cd-b01c-7c120a8b11a6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7ac4f5ea-23c0-4b50-b125-a98271eb666b req-0ebda4ba-8919-49cd-b01c-7c120a8b11a6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-7ac4f5ea-23c0-4b50-b125-a98271eb666b req-0ebda4ba-8919-49cd-b01c-7c120a8b11a6 service nova] Creating event network-changed:91c0bcc3-17a9-4444-bb3c-715e45188260 for instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 on user Apr 12 03:31:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-7ac4f5ea-23c0-4b50-b125-a98271eb666b req-0ebda4ba-8919-49cd-b01c-7c120a8b11a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033486 Apr 12 03:31:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:02 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Getting quotas for project bd808e7e237f4c7490abaff5db0e3529. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:31:02 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Getting quotas for user d29b6ed431d64bcab02c2348feab9aa6 and project bd808e7e237f4c7490abaff5db0e3529. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:31:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:31:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6a6c8492-c29c-49f6-954b-a9381cd886e1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0aea0a9e-658d-4acc-ba07-3ef1bace5eb9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f5da98e-cf9d-4e7e-b6fb-30a51a803fc3',volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:31:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0e91d655-ea02-48e5-826a-bd7f4a532d54 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 4.844813 Apr 12 03:31:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 29/90] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 03:30:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 4848 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:31:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e61f82d5-8d60-470d-81c5-79c3010b6b11 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e61f82d5-8d60-470d-81c5-79c3010b6b11 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:02 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-e61f82d5-8d60-470d-81c5-79c3010b6b11 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:02 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-e61f82d5-8d60-470d-81c5-79c3010b6b11 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:02 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-e61f82d5-8d60-470d-81c5-79c3010b6b11 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e61f82d5-8d60-470d-81c5-79c3010b6b11 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 200 len: 1279 microversion: 2.32 time: 0.087377 Apr 12 03:31:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 32/91] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:31:02 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:03 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d01e7aaa3734b299d0c0a27844011b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dadbf1b0a124d2d929c85bc2b916022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-cb6da282-85d3-4c3a-9355-3e2774a78577 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 200 len: 1490 microversion: 2.1 time: 0.245228 Apr 12 03:31:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 31/92] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:31:03 2023] GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 1490 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-5bd2db16-3941-4801-a525-d1b07c8ce021 req-72ba80a4-82a6-4ebd-a44c-f2d2efe439ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0", "name": "network-vif-plugged", "status": "completed", "tag": "91c0bcc3-17a9-4444-bb3c-715e45188260"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5bd2db16-3941-4801-a525-d1b07c8ce021 req-72ba80a4-82a6-4ebd-a44c-f2d2efe439ff service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5bd2db16-3941-4801-a525-d1b07c8ce021 req-72ba80a4-82a6-4ebd-a44c-f2d2efe439ff service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5bd2db16-3941-4801-a525-d1b07c8ce021 req-72ba80a4-82a6-4ebd-a44c-f2d2efe439ff service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5bd2db16-3941-4801-a525-d1b07c8ce021 req-72ba80a4-82a6-4ebd-a44c-f2d2efe439ff service nova] Creating event network-vif-plugged:91c0bcc3-17a9-4444-bb3c-715e45188260 for instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 on user Apr 12 03:31:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-5bd2db16-3941-4801-a525-d1b07c8ce021 req-72ba80a4-82a6-4ebd-a44c-f2d2efe439ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Apr 12 03:31:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 33/93] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:05 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c7671d3f-dc15-488d-a5c0-764acac7d21a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1551 microversion: 2.1 time: 0.533592 Apr 12 03:31:05 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 30/94] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:31:05 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1551 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-52489cd4-f574-44eb-8848-baa6d06d60da req-90b3200e-dfde-418a-9c88-3f4981524085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0", "name": "network-vif-plugged", "status": "completed", "tag": "91c0bcc3-17a9-4444-bb3c-715e45188260"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:07 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:07 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-52489cd4-f574-44eb-8848-baa6d06d60da req-90b3200e-dfde-418a-9c88-3f4981524085 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-52489cd4-f574-44eb-8848-baa6d06d60da req-90b3200e-dfde-418a-9c88-3f4981524085 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-52489cd4-f574-44eb-8848-baa6d06d60da req-90b3200e-dfde-418a-9c88-3f4981524085 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-52489cd4-f574-44eb-8848-baa6d06d60da req-90b3200e-dfde-418a-9c88-3f4981524085 service nova] Creating event network-vif-plugged:91c0bcc3-17a9-4444-bb3c-715e45188260 for instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 on user Apr 12 03:31:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-52489cd4-f574-44eb-8848-baa6d06d60da req-90b3200e-dfde-418a-9c88-3f4981524085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057688 Apr 12 03:31:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:09 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3962746f-4f69-4563-8fe6-cae5973f462f req-70e2480f-c56d-4c85-b47b-32c3154df6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3962746f-4f69-4563-8fe6-cae5973f462f req-70e2480f-c56d-4c85-b47b-32c3154df6d4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3962746f-4f69-4563-8fe6-cae5973f462f req-70e2480f-c56d-4c85-b47b-32c3154df6d4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3962746f-4f69-4563-8fe6-cae5973f462f req-70e2480f-c56d-4c85-b47b-32c3154df6d4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3962746f-4f69-4563-8fe6-cae5973f462f req-70e2480f-c56d-4c85-b47b-32c3154df6d4 service nova] Creating event network-changed:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3962746f-4f69-4563-8fe6-cae5973f462f req-70e2480f-c56d-4c85-b47b-32c3154df6d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038972 Apr 12 03:31:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 34/96] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-8b92eec3-2f0b-483e-a3e0-8c2711aa6a74 req-0b213fc9-8700-487f-aa0c-3baa19f5a563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "835b5a2a-4d35-4d2a-9fdd-0c78b7def163"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:11 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8b92eec3-2f0b-483e-a3e0-8c2711aa6a74 req-0b213fc9-8700-487f-aa0c-3baa19f5a563 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8b92eec3-2f0b-483e-a3e0-8c2711aa6a74 req-0b213fc9-8700-487f-aa0c-3baa19f5a563 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8b92eec3-2f0b-483e-a3e0-8c2711aa6a74 req-0b213fc9-8700-487f-aa0c-3baa19f5a563 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-8b92eec3-2f0b-483e-a3e0-8c2711aa6a74 req-0b213fc9-8700-487f-aa0c-3baa19f5a563 service nova] Creating event network-changed:835b5a2a-4d35-4d2a-9fdd-0c78b7def163 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-8b92eec3-2f0b-483e-a3e0-8c2711aa6a74 req-0b213fc9-8700-487f-aa0c-3baa19f5a563 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039698 Apr 12 03:31:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 31/97] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1006783758", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] validate_networks() for None {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Getting quotas for project f71b2bab30884740b8e6d2c268c7635b. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Getting quotas for user 1183761babfc4ba3b6f6febe28254c15 and project f71b2bab30884740b8e6d2c268c7635b. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:31:12 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:31:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-90d245db-ccfd-4b99-9938-f17c58f54d2c tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.410877 Apr 12 03:31:12 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 33/98] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:31:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:31:12 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4ef315b7-6fed-4d5a-bfed-535ea0ca74ad tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:12 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4ef315b7-6fed-4d5a-bfed-535ea0ca74ad tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:12 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-4ef315b7-6fed-4d5a-bfed-535ea0ca74ad tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1183761babfc4ba3b6f6febe28254c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b2bab30884740b8e6d2c268c7635b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4ef315b7-6fed-4d5a-bfed-535ea0ca74ad tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a" status: 200 len: 1209 microversion: 2.1 time: 0.070499 Apr 12 03:31:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 35/99] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:31:12 2023] GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a => generated 1209 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-3dfbe5a3-d4e9-4855-9ec6-3d9011d3965a req-30be2019-9397-4b26-83aa-38305c48d989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "a1aaff41-e246-4887-89c6-a91163d4efd5"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:13 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:13 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3dfbe5a3-d4e9-4855-9ec6-3d9011d3965a req-30be2019-9397-4b26-83aa-38305c48d989 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3dfbe5a3-d4e9-4855-9ec6-3d9011d3965a req-30be2019-9397-4b26-83aa-38305c48d989 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3dfbe5a3-d4e9-4855-9ec6-3d9011d3965a req-30be2019-9397-4b26-83aa-38305c48d989 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-3dfbe5a3-d4e9-4855-9ec6-3d9011d3965a req-30be2019-9397-4b26-83aa-38305c48d989 service nova] Creating event network-changed:a1aaff41-e246-4887-89c6-a91163d4efd5 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-3dfbe5a3-d4e9-4855-9ec6-3d9011d3965a req-30be2019-9397-4b26-83aa-38305c48d989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041899 Apr 12 03:31:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 32/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "ac401bfa-a662-4290-af6e-0a39e8fde61c"}, {"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] Creating event network-changed:ac401bfa-a662-4290-af6e-0a39e8fde61c for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] Creating event network-changed:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-285e088b-a101-41dd-9825-a5c577916b8e req-7448c8ce-aa12-4816-ac7d-57537bfc4c03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045107 Apr 12 03:31:15 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:17 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "4e57de22-e876-4bfe-bd07-a1003afd2295"}, {"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "7740f806-8319-484b-8b0f-bffd8c5fe532"}, {"name": "network-changed", "server_uuid": "f1a0f3cf-1004-4ff9-9e41-d03291abbb9a", "tag": "e9d42f8f-a0eb-4058-83e3-f5014b577443"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:17 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Creating event network-changed:4e57de22-e876-4bfe-bd07-a1003afd2295 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Creating event network-changed:7740f806-8319-484b-8b0f-bffd8c5fe532 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] Creating event network-changed:e9d42f8f-a0eb-4058-83e3-f5014b577443 for instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a on user Apr 12 03:31:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3d8454ba-a316-4b16-9625-264bf7b01586 req-c83bbb49-e4dd-435f-88eb-8cb282886f53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.039864 Apr 12 03:31:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 36/102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:19 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "8248913f-46c8-4f3d-ab47-0203cb267169"}, {"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "be3de447-6d22-4fec-b962-0ebe772ed86f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] Creating event network-changed:8248913f-46c8-4f3d-ab47-0203cb267169 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] Creating event network-changed:be3de447-6d22-4fec-b962-0ebe772ed86f for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f680e68c-3809-4af3-aef3-a6acb9b332c8 req-276e4ae3-718a-4a69-9c50-54e489f74ab4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038472 Apr 12 03:31:19 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:19 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b5437944-8a98-4308-a0f0-109a59fff3eb req-ee72359c-ba30-47e5-8cc4-fc6d35cc888a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a0f3cf-1004-4ff9-9e41-d03291abbb9a", "name": "network-vif-plugged", "status": "completed", "tag": "e9d42f8f-a0eb-4058-83e3-f5014b577443"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b5437944-8a98-4308-a0f0-109a59fff3eb req-ee72359c-ba30-47e5-8cc4-fc6d35cc888a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b5437944-8a98-4308-a0f0-109a59fff3eb req-ee72359c-ba30-47e5-8cc4-fc6d35cc888a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b5437944-8a98-4308-a0f0-109a59fff3eb req-ee72359c-ba30-47e5-8cc4-fc6d35cc888a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b5437944-8a98-4308-a0f0-109a59fff3eb req-ee72359c-ba30-47e5-8cc4-fc6d35cc888a service nova] Creating event network-vif-plugged:e9d42f8f-a0eb-4058-83e3-f5014b577443 for instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a on user Apr 12 03:31:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b5437944-8a98-4308-a0f0-109a59fff3eb req-ee72359c-ba30-47e5-8cc4-fc6d35cc888a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Apr 12 03:31:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "21860860-2a08-43dc-bda8-0a1d0fab0634"}, {"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "91177380-5d77-4bed-9ab0-e9085fcb3d5a"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] Creating event network-changed:21860860-2a08-43dc-bda8-0a1d0fab0634 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] Creating event network-changed:91177380-5d77-4bed-9ab0-e9085fcb3d5a for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-de5a623d-7a92-4567-be13-724a403a9a5c req-167d98d8-9e72-460b-ba3b-4afb1f3742ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058113 Apr 12 03:31:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 34/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:31:22 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fd9f0996bd48628564e6c170c11a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51faa215a1546fbaa0db25c9773ba6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:22 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2593e1b1-0029-4a72-a8e8-7cbf25a28400 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7" status: 200 len: 1523 microversion: 2.1 time: 0.214293 Apr 12 03:31:22 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 37/106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:31:21 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:22 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:22 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:22 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-5fbfc7e4-416b-4694-8e99-2ed00a8df3b6 req-fec353e5-4ac5-4e10-a69e-3b9c7d8a38bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a0f3cf-1004-4ff9-9e41-d03291abbb9a", "name": "network-vif-plugged", "status": "completed", "tag": "e9d42f8f-a0eb-4058-83e3-f5014b577443"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5fbfc7e4-416b-4694-8e99-2ed00a8df3b6 req-fec353e5-4ac5-4e10-a69e-3b9c7d8a38bf service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5fbfc7e4-416b-4694-8e99-2ed00a8df3b6 req-fec353e5-4ac5-4e10-a69e-3b9c7d8a38bf service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5fbfc7e4-416b-4694-8e99-2ed00a8df3b6 req-fec353e5-4ac5-4e10-a69e-3b9c7d8a38bf service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-5fbfc7e4-416b-4694-8e99-2ed00a8df3b6 req-fec353e5-4ac5-4e10-a69e-3b9c7d8a38bf service nova] Creating event network-vif-plugged:e9d42f8f-a0eb-4058-83e3-f5014b577443 for instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a on user Apr 12 03:31:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-5fbfc7e4-416b-4694-8e99-2ed00a8df3b6 req-fec353e5-4ac5-4e10-a69e-3b9c7d8a38bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 Apr 12 03:31:22 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "41626728-b21d-4ef8-9d86-5328d2feb3f9"}, {"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "6bb0c89d-0a60-4413-b09d-08d4d6ea3a52"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] Creating event network-changed:41626728-b21d-4ef8-9d86-5328d2feb3f9 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] Creating event network-changed:6bb0c89d-0a60-4413-b09d-08d4d6ea3a52 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-0a1d6368-b29c-4a13-8935-b2a2a92153ec req-63e75760-012d-44ad-97aa-3ade75405076 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057741 Apr 12 03:31:24 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 35/108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-680158b1-d078-4407-bb04-2eb5f0a3eb02 req-caf43d50-3f35-43c4-bfc0-c303ca242ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:26 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=16 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-680158b1-d078-4407-bb04-2eb5f0a3eb02 req-caf43d50-3f35-43c4-bfc0-c303ca242ce9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-680158b1-d078-4407-bb04-2eb5f0a3eb02 req-caf43d50-3f35-43c4-bfc0-c303ca242ce9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-680158b1-d078-4407-bb04-2eb5f0a3eb02 req-caf43d50-3f35-43c4-bfc0-c303ca242ce9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:26 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=21 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-680158b1-d078-4407-bb04-2eb5f0a3eb02 req-caf43d50-3f35-43c4-bfc0-c303ca242ce9 service nova] Creating event network-changed:e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-680158b1-d078-4407-bb04-2eb5f0a3eb02 req-caf43d50-3f35-43c4-bfc0-c303ca242ce9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036014 Apr 12 03:31:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 38/109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:26 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=33 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:27 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431c372c4da24fa692f43f2d16764755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a92643aee44b66864aa10c2cf6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f17c2731-a613-4593-b179-ce331f01d148 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 200 len: 1549 microversion: 2.1 time: 0.200777 Apr 12 03:31:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:31:26 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 1549 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-87233480-805b-4014-8b03-4abef0513c57 req-fe1e671d-82f6-48c3-bc0c-d765cbb37fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-87233480-805b-4014-8b03-4abef0513c57 req-fe1e671d-82f6-48c3-bc0c-d765cbb37fd7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-87233480-805b-4014-8b03-4abef0513c57 req-fe1e671d-82f6-48c3-bc0c-d765cbb37fd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-87233480-805b-4014-8b03-4abef0513c57 req-fe1e671d-82f6-48c3-bc0c-d765cbb37fd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:31 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=19 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-87233480-805b-4014-8b03-4abef0513c57 req-fe1e671d-82f6-48c3-bc0c-d765cbb37fd7 service nova] Creating event network-vif-plugged:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-87233480-805b-4014-8b03-4abef0513c57 req-fe1e671d-82f6-48c3-bc0c-d765cbb37fd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062212 Apr 12 03:31:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 36/111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:32 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3a034232-f78e-4323-9c73-270fd9a46bae req-849e7f74-e6f2-4d74-9818-7af26cceafd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "a1aaff41-e246-4887-89c6-a91163d4efd5"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3a034232-f78e-4323-9c73-270fd9a46bae req-849e7f74-e6f2-4d74-9818-7af26cceafd7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3a034232-f78e-4323-9c73-270fd9a46bae req-849e7f74-e6f2-4d74-9818-7af26cceafd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3a034232-f78e-4323-9c73-270fd9a46bae req-849e7f74-e6f2-4d74-9818-7af26cceafd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-a2549a14-b550-4e4e-bc5a-3ff351476a91 req-6b227506-70c8-44e5-a89c-fb9e02f29e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "ac401bfa-a662-4290-af6e-0a39e8fde61c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a2549a14-b550-4e4e-bc5a-3ff351476a91 req-6b227506-70c8-44e5-a89c-fb9e02f29e34 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a2549a14-b550-4e4e-bc5a-3ff351476a91 req-6b227506-70c8-44e5-a89c-fb9e02f29e34 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a2549a14-b550-4e4e-bc5a-3ff351476a91 req-6b227506-70c8-44e5-a89c-fb9e02f29e34 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:32 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3a034232-f78e-4323-9c73-270fd9a46bae req-849e7f74-e6f2-4d74-9818-7af26cceafd7 service nova] Creating event network-vif-plugged:a1aaff41-e246-4887-89c6-a91163d4efd5 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a2549a14-b550-4e4e-bc5a-3ff351476a91 req-6b227506-70c8-44e5-a89c-fb9e02f29e34 service nova] Creating event network-vif-plugged:ac401bfa-a662-4290-af6e-0a39e8fde61c for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-a2549a14-b550-4e4e-bc5a-3ff351476a91 req-6b227506-70c8-44e5-a89c-fb9e02f29e34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036446 Apr 12 03:31:32 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:32 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3a034232-f78e-4323-9c73-270fd9a46bae req-849e7f74-e6f2-4d74-9818-7af26cceafd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074944 Apr 12 03:31:32 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:33 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "835b5a2a-4d35-4d2a-9fdd-0c78b7def163"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "835b5a2a-4d35-4d2a-9fdd-0c78b7def163"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "4e57de22-e876-4bfe-bd07-a1003afd2295"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "4e57de22-e876-4bfe-bd07-a1003afd2295"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "21860860-2a08-43dc-bda8-0a1d0fab0634"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Creating event network-vif-plugged:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Creating event network-vif-plugged:835b5a2a-4d35-4d2a-9fdd-0c78b7def163 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Creating event network-vif-plugged:835b5a2a-4d35-4d2a-9fdd-0c78b7def163 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Creating event network-vif-plugged:4e57de22-e876-4bfe-bd07-a1003afd2295 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Creating event network-vif-plugged:4e57de22-e876-4bfe-bd07-a1003afd2295 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] Creating event network-vif-plugged:21860860-2a08-43dc-bda8-0a1d0fab0634 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f73e806d-e826-406a-9788-fa6fcb257bbb req-2d840686-2cfa-4ecb-8e60-0832bfcb9a1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.056802 Apr 12 03:31:33 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 37/114] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:33 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "ac401bfa-a662-4290-af6e-0a39e8fde61c"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "8248913f-46c8-4f3d-ab47-0203cb267169"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "8248913f-46c8-4f3d-ab47-0203cb267169"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:34 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:34 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-8f2c60b2-8885-44e5-a63f-08b2dda2452a req-5642d154-64e1-4870-a85c-9627bf9eef5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "a1aaff41-e246-4887-89c6-a91163d4efd5"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8f2c60b2-8885-44e5-a63f-08b2dda2452a req-5642d154-64e1-4870-a85c-9627bf9eef5f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8f2c60b2-8885-44e5-a63f-08b2dda2452a req-5642d154-64e1-4870-a85c-9627bf9eef5f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8f2c60b2-8885-44e5-a63f-08b2dda2452a req-5642d154-64e1-4870-a85c-9627bf9eef5f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Creating event network-vif-plugged:ac401bfa-a662-4290-af6e-0a39e8fde61c for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Creating event network-vif-plugged:8248913f-46c8-4f3d-ab47-0203cb267169 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] Creating event network-vif-plugged:8248913f-46c8-4f3d-ab47-0203cb267169 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-bb2c5c71-c77b-4bbb-89ef-73756e266f79 req-eb490d8a-95ca-447e-92ec-83b94e387f0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039078 Apr 12 03:31:34 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:34 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:34 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-8f2c60b2-8885-44e5-a63f-08b2dda2452a req-5642d154-64e1-4870-a85c-9627bf9eef5f service nova] Creating event network-vif-plugged:a1aaff41-e246-4887-89c6-a91163d4efd5 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:34 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-8f2c60b2-8885-44e5-a63f-08b2dda2452a req-5642d154-64e1-4870-a85c-9627bf9eef5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049253 Apr 12 03:31:34 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-dfd8e0b3-da22-48a2-aac6-8bea802411a3 req-9699ee1f-c485-46fa-8c21-b9f661f44496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "21860860-2a08-43dc-bda8-0a1d0fab0634"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-dfd8e0b3-da22-48a2-aac6-8bea802411a3 req-9699ee1f-c485-46fa-8c21-b9f661f44496 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-dfd8e0b3-da22-48a2-aac6-8bea802411a3 req-9699ee1f-c485-46fa-8c21-b9f661f44496 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-dfd8e0b3-da22-48a2-aac6-8bea802411a3 req-9699ee1f-c485-46fa-8c21-b9f661f44496 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:36 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-dfd8e0b3-da22-48a2-aac6-8bea802411a3 req-9699ee1f-c485-46fa-8c21-b9f661f44496 service nova] Creating event network-vif-plugged:21860860-2a08-43dc-bda8-0a1d0fab0634 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:31:36 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-dfd8e0b3-da22-48a2-aac6-8bea802411a3 req-9699ee1f-c485-46fa-8c21-b9f661f44496 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059759 Apr 12 03:31:36 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 38/117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-3d1033b6-012d-4f84-b058-943d987177da req-91a9bc01-5d6c-4116-8306-f2376f1e2f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "be3de447-6d22-4fec-b962-0ebe772ed86f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3d1033b6-012d-4f84-b058-943d987177da req-91a9bc01-5d6c-4116-8306-f2376f1e2f76 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3d1033b6-012d-4f84-b058-943d987177da req-91a9bc01-5d6c-4116-8306-f2376f1e2f76 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3d1033b6-012d-4f84-b058-943d987177da req-91a9bc01-5d6c-4116-8306-f2376f1e2f76 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-3d1033b6-012d-4f84-b058-943d987177da req-91a9bc01-5d6c-4116-8306-f2376f1e2f76 service nova] Creating event network-vif-plugged:be3de447-6d22-4fec-b962-0ebe772ed86f for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-3d1033b6-012d-4f84-b058-943d987177da req-91a9bc01-5d6c-4116-8306-f2376f1e2f76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052015 Apr 12 03:31:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-8f401b5d-2169-41d9-8818-885ab51ab63d req-0783f96e-e4f3-48a0-92ce-8ff78c51f611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "41626728-b21d-4ef8-9d86-5328d2feb3f9"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8f401b5d-2169-41d9-8818-885ab51ab63d req-0783f96e-e4f3-48a0-92ce-8ff78c51f611 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8f401b5d-2169-41d9-8818-885ab51ab63d req-0783f96e-e4f3-48a0-92ce-8ff78c51f611 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8f401b5d-2169-41d9-8818-885ab51ab63d req-0783f96e-e4f3-48a0-92ce-8ff78c51f611 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-8f401b5d-2169-41d9-8818-885ab51ab63d req-0783f96e-e4f3-48a0-92ce-8ff78c51f611 service nova] Creating event network-vif-plugged:41626728-b21d-4ef8-9d86-5328d2feb3f9 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-8f401b5d-2169-41d9-8818-885ab51ab63d req-0783f96e-e4f3-48a0-92ce-8ff78c51f611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071388 Apr 12 03:31:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:38 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "7740f806-8319-484b-8b0f-bffd8c5fe532"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "7740f806-8319-484b-8b0f-bffd8c5fe532"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "91177380-5d77-4bed-9ab0-e9085fcb3d5a"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "91177380-5d77-4bed-9ab0-e9085fcb3d5a"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "6bb0c89d-0a60-4413-b09d-08d4d6ea3a52"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:7740f806-8319-484b-8b0f-bffd8c5fe532 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:7740f806-8319-484b-8b0f-bffd8c5fe532 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:91177380-5d77-4bed-9ab0-e9085fcb3d5a for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:91177380-5d77-4bed-9ab0-e9085fcb3d5a for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] Creating event network-vif-plugged:6bb0c89d-0a60-4413-b09d-08d4d6ea3a52 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-39b147e8-c780-4481-985e-25dd30ae2d96 req-ab277d77-7372-4dbe-8ab9-ce7f1d3c7f76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.051847 Apr 12 03:31:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 39/120] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 03:31:38 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:39 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-d449df27-14bd-44bc-ac66-cf7e2e93d327 req-99792d73-24c6-49b6-92b5-79b62d339113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "be3de447-6d22-4fec-b962-0ebe772ed86f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d449df27-14bd-44bc-ac66-cf7e2e93d327 req-99792d73-24c6-49b6-92b5-79b62d339113 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d449df27-14bd-44bc-ac66-cf7e2e93d327 req-99792d73-24c6-49b6-92b5-79b62d339113 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d449df27-14bd-44bc-ac66-cf7e2e93d327 req-99792d73-24c6-49b6-92b5-79b62d339113 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-d449df27-14bd-44bc-ac66-cf7e2e93d327 req-99792d73-24c6-49b6-92b5-79b62d339113 service nova] Creating event network-vif-plugged:be3de447-6d22-4fec-b962-0ebe772ed86f for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-d449df27-14bd-44bc-ac66-cf7e2e93d327 req-99792d73-24c6-49b6-92b5-79b62d339113 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Apr 12 03:31:39 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-7c9b10fa-4758-473d-8983-be154863b243 req-120fd041-9e1c-4333-92d9-1b6070006e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "41626728-b21d-4ef8-9d86-5328d2feb3f9"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7c9b10fa-4758-473d-8983-be154863b243 req-120fd041-9e1c-4333-92d9-1b6070006e74 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7c9b10fa-4758-473d-8983-be154863b243 req-120fd041-9e1c-4333-92d9-1b6070006e74 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7c9b10fa-4758-473d-8983-be154863b243 req-120fd041-9e1c-4333-92d9-1b6070006e74 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-7c9b10fa-4758-473d-8983-be154863b243 req-120fd041-9e1c-4333-92d9-1b6070006e74 service nova] Creating event network-vif-plugged:41626728-b21d-4ef8-9d86-5328d2feb3f9 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-7c9b10fa-4758-473d-8983-be154863b243 req-120fd041-9e1c-4333-92d9-1b6070006e74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Apr 12 03:31:39 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "6bb0c89d-0a60-4413-b09d-08d4d6ea3a52"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Creating event network-vif-plugged:6bb0c89d-0a60-4413-b09d-08d4d6ea3a52 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Creating event network-vif-plugged:e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] Creating event network-vif-plugged:e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:31:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-12e64648-54c3-4c2f-a842-4eff1d20c5de req-2e8c793b-f83f-483d-9a88-da18225ae76c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.031258 Apr 12 03:31:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 40/123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:31:40 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:47 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84ea3a8776a944178ba5a04bce4d9b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f7b42b161f41efb234f0ce70210a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e20893aa-969c-43ef-baae-e30d78efb0dc tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0" status: 200 len: 1496 microversion: 2.1 time: 0.157646 Apr 12 03:31:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 42/124] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:31:46 2023] GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:47 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-50f56903-67f6-4784-a658-69970e68aa76 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 200 len: 2824 microversion: 2.42 time: 0.236791 Apr 12 03:31:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 43/125] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:31:47 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 2824 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=19 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=9 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:52 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:31:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-72a0335d-1a1b-4cc8-9bc4-ff7e96dc06aa tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 200 len: 2819 microversion: 2.32 time: 0.234780 Apr 12 03:31:52 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 41/126] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:31:52 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 2819 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673161590", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "1a483654-b740-4544-84c9-53a41c11fa88"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=7 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=19 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] validate_networks() for [('1a483654-b740-4544-84c9-53a41c11fa88', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:31:59 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Getting quotas for project 83a7ef3f97fd47849973d4e4482fb5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Getting quotas for user 3da7394c51664a7caacfda6b7dda9066 and project 83a7ef3f97fd47849973d4e4482fb5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:32:00 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-65154dff-aed8-4e8e-aa78-24272b5bbaa3 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.502698 Apr 12 03:32:00 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:31:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:32:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d4578bbc-966c-4283-bb00-58fc09a14284 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:00 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d4578bbc-966c-4283-bb00-58fc09a14284 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:00 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=15 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:00 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=15 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-d4578bbc-966c-4283-bb00-58fc09a14284 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d4578bbc-966c-4283-bb00-58fc09a14284 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 200 len: 1211 microversion: 2.1 time: 0.091328 Apr 12 03:32:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 44/128] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:32:00 2023] GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-728915476"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f0820707-1f5f-494a-82ab-1afcff073cb6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.398308 Apr 12 03:32:00 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 42/129] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:32:00 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-interface => generated 282 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 03:32:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-72eaa388-fa0b-4ce8-8695-6b1901c05616 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5/action" status: 202 len: 52 microversion: 2.87 time: 1.212819 Apr 12 03:32:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 44/130] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:32:00 2023] POST /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5/action => generated 52 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 03:32:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-007b8e88-0035-4732-8f58-af3d83d08c4c req-e29ce0a9-7d0c-4ddf-9514-a943c9f9552c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-007b8e88-0035-4732-8f58-af3d83d08c4c req-e29ce0a9-7d0c-4ddf-9514-a943c9f9552c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-007b8e88-0035-4732-8f58-af3d83d08c4c req-e29ce0a9-7d0c-4ddf-9514-a943c9f9552c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-007b8e88-0035-4732-8f58-af3d83d08c4c req-e29ce0a9-7d0c-4ddf-9514-a943c9f9552c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-007b8e88-0035-4732-8f58-af3d83d08c4c req-e29ce0a9-7d0c-4ddf-9514-a943c9f9552c service nova] Creating event network-changed:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-007b8e88-0035-4732-8f58-af3d83d08c4c req-e29ce0a9-7d0c-4ddf-9514-a943c9f9552c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058826 Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6856e0f8-1325-4d57-988b-4c8298b9b0fe tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/ips" status: 200 len: 109 microversion: 2.20 time: 0.042218 Apr 12 03:32:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 43/132] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 03:32:02 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:02 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1183761babfc4ba3b6f6febe28254c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b2bab30884740b8e6d2c268c7635b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-69dc93ab-96d9-42af-8253-825cbbed2008 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a" status: 200 len: 1455 microversion: 2.1 time: 0.164516 Apr 12 03:32:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 45/133] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:32:02 2023] GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-4d0fd191-b47f-42e6-bc6e-5a63ca689498 req-287284fb-bc04-4c07-886e-7663796fd558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4d0fd191-b47f-42e6-bc6e-5a63ca689498 req-287284fb-bc04-4c07-886e-7663796fd558 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4d0fd191-b47f-42e6-bc6e-5a63ca689498 req-287284fb-bc04-4c07-886e-7663796fd558 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4d0fd191-b47f-42e6-bc6e-5a63ca689498 req-287284fb-bc04-4c07-886e-7663796fd558 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-4d0fd191-b47f-42e6-bc6e-5a63ca689498 req-287284fb-bc04-4c07-886e-7663796fd558 service nova] Creating event network-changed:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:32:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-4d0fd191-b47f-42e6-bc6e-5a63ca689498 req-287284fb-bc04-4c07-886e-7663796fd558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032025 Apr 12 03:32:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 46/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:03 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lazy-loading 'flavor' on Instance uuid b23d4bcd-989a-45e1-89a3-6e3d30229a32 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:32:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-073bc7f5-3172-4aaa-82c2-c67395afd7ba tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/action" status: 202 len: 0 microversion: 2.20 time: 1.068323 Apr 12 03:32:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 44/135] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:32:03 2023] POST /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:04 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d692b833-cc07-44da-be9d-c646ac1d5749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1711 microversion: 2.20 time: 0.200180 Apr 12 03:32:04 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 46/136] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:04 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1711 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1dc2f8c3-d23a-454e-a6dd-da78e726814c req-35a5369d-6e9a-4245-9202-40d075c3fcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-unplugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1dc2f8c3-d23a-454e-a6dd-da78e726814c req-35a5369d-6e9a-4245-9202-40d075c3fcce service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1dc2f8c3-d23a-454e-a6dd-da78e726814c req-35a5369d-6e9a-4245-9202-40d075c3fcce service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1dc2f8c3-d23a-454e-a6dd-da78e726814c req-35a5369d-6e9a-4245-9202-40d075c3fcce service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1dc2f8c3-d23a-454e-a6dd-da78e726814c req-35a5369d-6e9a-4245-9202-40d075c3fcce service nova] Creating event network-vif-unplugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:32:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1dc2f8c3-d23a-454e-a6dd-da78e726814c req-35a5369d-6e9a-4245-9202-40d075c3fcce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048111 Apr 12 03:32:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23b341e1-3bd9-452a-851e-83de16a594e6"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-04712b1c-dae6-42c8-8157-6abf69bcc31d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351224 Apr 12 03:32:05 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 45/138] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:32:05 2023] POST /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-665b4f72-1c71-4c85-b9a0-96b114644e8e tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.087199 Apr 12 03:32:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 47/139] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:32:05 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-interface => generated 282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-70cfc7e3-8b03-433d-87f6-5d367fca5719 req-7914faf0-eba1-42be-9d83-bda9c35e094f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-70cfc7e3-8b03-433d-87f6-5d367fca5719 req-7914faf0-eba1-42be-9d83-bda9c35e094f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-70cfc7e3-8b03-433d-87f6-5d367fca5719 req-7914faf0-eba1-42be-9d83-bda9c35e094f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-70cfc7e3-8b03-433d-87f6-5d367fca5719 req-7914faf0-eba1-42be-9d83-bda9c35e094f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-70cfc7e3-8b03-433d-87f6-5d367fca5719 req-7914faf0-eba1-42be-9d83-bda9c35e094f service nova] Creating event network-changed:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:32:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-70cfc7e3-8b03-433d-87f6-5d367fca5719 req-7914faf0-eba1-42be-9d83-bda9c35e094f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037429 Apr 12 03:32:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1156477554"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-plugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}, {"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-plugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}, {"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-plugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Creating event network-vif-plugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:32:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Creating event network-vif-plugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:32:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] Creating event network-vif-plugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:32:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-2bddd0ed-55e1-405f-a106-70cd6f546cac req-ac0b5f2f-e2bc-47c9-b38c-26c555e9371a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035171 Apr 12 03:32:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 48/141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:32:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-5bc25c7e-7e44-4cf1-b19a-7e3475757df6 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/action" status: 202 len: 0 microversion: 2.1 time: 0.784238 Apr 12 03:32:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 46/142] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:32:06 2023] POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 12 03:32:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a52b3c28-b589-4454-9364-5c6c3fc36bab tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '.version_select at 0x7f76a704dd80>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a52b3c28-b589-4454-9364-5c6c3fc36bab tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca" status: 200 len: 1609 microversion: 2.1 time: 0.048583 Apr 12 03:32:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 03:32:07 2023] GET /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca => generated 1609 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:08 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:08 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ba6c1cc2-938d-412b-9514-146a462f64de tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5" status: 200 len: 1692 microversion: 2.87 time: 0.225784 Apr 12 03:32:08 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:08 2023] GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 => generated 1692 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:10 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7928f17f-209b-4ee8-a4c4-9a3e34da17c9 req-6bc45eb6-f9ac-416c-9a20-8bed8d17439b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7928f17f-209b-4ee8-a4c4-9a3e34da17c9 req-6bc45eb6-f9ac-416c-9a20-8bed8d17439b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7928f17f-209b-4ee8-a4c4-9a3e34da17c9 req-6bc45eb6-f9ac-416c-9a20-8bed8d17439b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7928f17f-209b-4ee8-a4c4-9a3e34da17c9 req-6bc45eb6-f9ac-416c-9a20-8bed8d17439b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7928f17f-209b-4ee8-a4c4-9a3e34da17c9 req-6bc45eb6-f9ac-416c-9a20-8bed8d17439b service nova] Creating event network-changed:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:32:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7928f17f-209b-4ee8-a4c4-9a3e34da17c9 req-6bc45eb6-f9ac-416c-9a20-8bed8d17439b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059289 Apr 12 03:32:10 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 47/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:13 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:32:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-be494c85-a24e-4505-8d06-e562ed5c548d tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 204 len: 0 microversion: 2.1 time: 0.175797 Apr 12 03:32:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 50/146] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:32:13 2023] DELETE /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:13 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d01e7aaa3734b299d0c0a27844011b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dadbf1b0a124d2d929c85bc2b916022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-bda5cc91-2286-48a1-aa30-58571fb11a4a tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 200 len: 1542 microversion: 2.1 time: 0.155292 Apr 12 03:32:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 50/147] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:32:13 2023] GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 1542 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-8bf98f4e-a844-4648-9aea-0a3916069d8b req-759f67ba-2112-4b06-80e1-8877a063e22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4ab4cb-6164-47ea-be1d-cbe0698f991d", "name": "network-vif-unplugged", "status": "completed", "tag": "cc0a860c-4dc1-4a09-836a-3878bcb30d40"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8bf98f4e-a844-4648-9aea-0a3916069d8b req-759f67ba-2112-4b06-80e1-8877a063e22f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8bf98f4e-a844-4648-9aea-0a3916069d8b req-759f67ba-2112-4b06-80e1-8877a063e22f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8bf98f4e-a844-4648-9aea-0a3916069d8b req-759f67ba-2112-4b06-80e1-8877a063e22f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-8bf98f4e-a844-4648-9aea-0a3916069d8b req-759f67ba-2112-4b06-80e1-8877a063e22f service nova] Creating event network-vif-unplugged:cc0a860c-4dc1-4a09-836a-3878bcb30d40 for instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d on user Apr 12 03:32:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-8bf98f4e-a844-4648-9aea-0a3916069d8b req-759f67ba-2112-4b06-80e1-8877a063e22f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030066 Apr 12 03:32:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 48/148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c249cfef-d3ff-4928-8189-5f7228f01026 req-063bab42-82d9-4009-97aa-54a555d19aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4ab4cb-6164-47ea-be1d-cbe0698f991d", "name": "network-vif-deleted", "tag": "cc0a860c-4dc1-4a09-836a-3878bcb30d40"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c249cfef-d3ff-4928-8189-5f7228f01026 req-063bab42-82d9-4009-97aa-54a555d19aed service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c249cfef-d3ff-4928-8189-5f7228f01026 req-063bab42-82d9-4009-97aa-54a555d19aed service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c249cfef-d3ff-4928-8189-5f7228f01026 req-063bab42-82d9-4009-97aa-54a555d19aed service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c249cfef-d3ff-4928-8189-5f7228f01026 req-063bab42-82d9-4009-97aa-54a555d19aed service nova] Creating event network-vif-deleted:cc0a860c-4dc1-4a09-836a-3878bcb30d40 for instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d on user Apr 12 03:32:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c249cfef-d3ff-4928-8189-5f7228f01026 req-063bab42-82d9-4009-97aa-54a555d19aed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028446 Apr 12 03:32:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:32:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-cc8e20d9-a45e-4ae6-8f21-67b410d7a117 req-513a7b13-fb61-4676-8f73-1088ccd73a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4ab4cb-6164-47ea-be1d-cbe0698f991d", "name": "network-vif-plugged", "status": "completed", "tag": "cc0a860c-4dc1-4a09-836a-3878bcb30d40"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cc8e20d9-a45e-4ae6-8f21-67b410d7a117 req-513a7b13-fb61-4676-8f73-1088ccd73a7c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cc8e20d9-a45e-4ae6-8f21-67b410d7a117 req-513a7b13-fb61-4676-8f73-1088ccd73a7c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cc8e20d9-a45e-4ae6-8f21-67b410d7a117 req-513a7b13-fb61-4676-8f73-1088ccd73a7c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cc8e20d9-a45e-4ae6-8f21-67b410d7a117 req-513a7b13-fb61-4676-8f73-1088ccd73a7c service nova] Creating event network-vif-plugged:cc0a860c-4dc1-4a09-836a-3878bcb30d40 for instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d on user Apr 12 03:32:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-cc8e20d9-a45e-4ae6-8f21-67b410d7a117 req-513a7b13-fb61-4676-8f73-1088ccd73a7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 Apr 12 03:32:15 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 51/150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-50a6d7ab-98c1-46f1-9ca4-3ff42ebd1a4e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.130338 Apr 12 03:32:22 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 49/151] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:32:22 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-interface => generated 283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:23 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-e6a62604-eda8-4c09-b1a4-20e7eaf2d06b req-9f8d6d9c-631c-4342-9242-9112bc711a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e6a62604-eda8-4c09-b1a4-20e7eaf2d06b req-9f8d6d9c-631c-4342-9242-9112bc711a9f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e6a62604-eda8-4c09-b1a4-20e7eaf2d06b req-9f8d6d9c-631c-4342-9242-9112bc711a9f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e6a62604-eda8-4c09-b1a4-20e7eaf2d06b req-9f8d6d9c-631c-4342-9242-9112bc711a9f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-e6a62604-eda8-4c09-b1a4-20e7eaf2d06b req-9f8d6d9c-631c-4342-9242-9112bc711a9f service nova] Creating event network-changed:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:32:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-e6a62604-eda8-4c09-b1a4-20e7eaf2d06b req-9f8d6d9c-631c-4342-9242-9112bc711a9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031910 Apr 12 03:32:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 52/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a21ca3f-3f2d-48d7-a96c-c1f123ae3bb3"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1bfc8386-b26b-4b0a-98ac-d2ce5f3ac4f2 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289352 Apr 12 03:32:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 52/153] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:32:23 2023] POST /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=19 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:27 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-1ba0d3e3-b871-4b2d-b9ea-287cd9baad4e tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.096658 Apr 12 03:32:27 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 50/154] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:32:27 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-interface => generated 283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c5ec4ac4-48c4-45e6-bf3e-f3d8e28ac27a req-9878d4c3-ff51-45ce-afef-804e5e26966a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c5ec4ac4-48c4-45e6-bf3e-f3d8e28ac27a req-9878d4c3-ff51-45ce-afef-804e5e26966a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c5ec4ac4-48c4-45e6-bf3e-f3d8e28ac27a req-9878d4c3-ff51-45ce-afef-804e5e26966a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c5ec4ac4-48c4-45e6-bf3e-f3d8e28ac27a req-9878d4c3-ff51-45ce-afef-804e5e26966a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c5ec4ac4-48c4-45e6-bf3e-f3d8e28ac27a req-9878d4c3-ff51-45ce-afef-804e5e26966a service nova] Creating event network-changed:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:32:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c5ec4ac4-48c4-45e6-bf3e-f3d8e28ac27a req-9878d4c3-ff51-45ce-afef-804e5e26966a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030979 Apr 12 03:32:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 53/155] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61ed3b81-1f3d-4068-aaa7-15aa2403a330"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:29 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:29 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4a8cc635-2a1f-4102-bff7-5b2c769ad5e3 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "POST /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374251 Apr 12 03:32:29 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:32:29 2023] POST /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9a82b8b7-d64b-4407-869f-d5b1dcdf0550"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ee583708-0bae-4adf-8e68-15e43a101493 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments/6a21ca3f-3f2d-48d7-a96c-c1f123ae3bb3" status: 202 len: 0 microversion: 2.1 time: 0.506918 Apr 12 03:32:32 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 51/157] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 03:32:31 2023] PUT /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments/6a21ca3f-3f2d-48d7-a96c-c1f123ae3bb3 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e91a16ea-b281-412e-8c42-6efa7f0ea088 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053450 Apr 12 03:32:39 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 54/158] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:39 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:39 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lazy-loading 'services' on Instance uuid 413850ca-8175-4ed6-a6cf-ff42230fa1e0 {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:32:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f6c3065b-988d-40c3-9a56-dbd36b4b0912 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments/61ed3b81-1f3d-4068-aaa7-15aa2403a330" status: 202 len: 0 microversion: 2.1 time: 0.268085 Apr 12 03:32:39 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:32:39 2023] DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments/61ed3b81-1f3d-4068-aaa7-15aa2403a330 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-932a3225-a1ed-467c-aee8-57eb456d9182 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072981 Apr 12 03:32:42 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 52/160] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:42 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1dc79ac0-bb86-4a09-8c53-a23a409d3cff tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074154 Apr 12 03:32:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:42 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:32:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4593571d-cd4e-4242-8aeb-e6c5424f0bb7 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 204 len: 0 microversion: 2.1 time: 0.166072 Apr 12 03:32:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:32:42 2023] DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:42 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431c372c4da24fa692f43f2d16764755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a92643aee44b66864aa10c2cf6f048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0dbe9181-f7d8-4eba-9603-f86d9eba8a56 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 200 len: 1674 microversion: 2.1 time: 0.358435 Apr 12 03:32:42 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 53/163] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:32:42 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 1674 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:43 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-15e5a08d-a7ba-4833-b593-7eec3a0b953d req-924343be-0f1c-4b16-9683-ec60c7475b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "name": "network-vif-unplugged", "status": "completed", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-15e5a08d-a7ba-4833-b593-7eec3a0b953d req-924343be-0f1c-4b16-9683-ec60c7475b39 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-15e5a08d-a7ba-4833-b593-7eec3a0b953d req-924343be-0f1c-4b16-9683-ec60c7475b39 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-15e5a08d-a7ba-4833-b593-7eec3a0b953d req-924343be-0f1c-4b16-9683-ec60c7475b39 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:43 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-15e5a08d-a7ba-4833-b593-7eec3a0b953d req-924343be-0f1c-4b16-9683-ec60c7475b39 service nova] Creating event network-vif-unplugged:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:32:43 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-15e5a08d-a7ba-4833-b593-7eec3a0b953d req-924343be-0f1c-4b16-9683-ec60c7475b39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064038 Apr 12 03:32:43 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "name": "network-vif-plugged", "status": "completed", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}, {"server_uuid": "413850ca-8175-4ed6-a6cf-ff42230fa1e0", "name": "network-vif-deleted", "tag": "7b7ff2ca-c0a4-4414-9eed-62bd43be3613"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] Creating event network-vif-plugged:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:32:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] Creating event network-vif-deleted:7b7ff2ca-c0a4-4414-9eed-62bd43be3613 for instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 on user Apr 12 03:32:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-a38460b2-b9e8-4efc-99f7-60cde1ad6dc7 req-42a72de7-2786-42be-83ca-87f200f014d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035402 Apr 12 03:32:45 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 56/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-db342997-f6e6-418f-bad3-ce193700809e tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071043 Apr 12 03:32:46 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 54/166] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:45 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-55559ebd-0a21-43d6-bbc4-6a8c622b6e66 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 Apr 12 03:32:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:46 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6a21ca3f-3f2d-48d7-a96c-c1f123ae3bb3"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ff962041-66d5-4114-a9de-5cd7619edb11 tempest-TestVolumeSwap-1083163114 tempest-TestVolumeSwap-1083163114-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments/9a82b8b7-d64b-4407-869f-d5b1dcdf0550" status: 202 len: 0 microversion: 2.1 time: 0.308022 Apr 12 03:32:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 57/168] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 03:32:46 2023] PUT /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments/9a82b8b7-d64b-4407-869f-d5b1dcdf0550 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "263426d6-d387-4a67-9013-5a23e8386c93", "device": "/dev/vdb"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4b2fc291-f18f-4a89-959f-8659be17743f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299840 Apr 12 03:32:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 55/169] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:32:47 2023] POST /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-baa901c1-4645-485a-8f63-83ef789c3c7e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.140628 Apr 12 03:32:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 58/170] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:32:47 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4/os-interface => generated 1829 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:48 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b773a5d3-7b8c-4704-a6b4-95c5a01fd1fb req-a90f1dae-4504-4e5c-92e1-cf35bc1e2e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:48 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b773a5d3-7b8c-4704-a6b4-95c5a01fd1fb req-a90f1dae-4504-4e5c-92e1-cf35bc1e2e5c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:48 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b773a5d3-7b8c-4704-a6b4-95c5a01fd1fb req-a90f1dae-4504-4e5c-92e1-cf35bc1e2e5c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:48 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b773a5d3-7b8c-4704-a6b4-95c5a01fd1fb req-a90f1dae-4504-4e5c-92e1-cf35bc1e2e5c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:48 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b773a5d3-7b8c-4704-a6b4-95c5a01fd1fb req-a90f1dae-4504-4e5c-92e1-cf35bc1e2e5c service nova] Creating event network-changed:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:48 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b773a5d3-7b8c-4704-a6b4-95c5a01fd1fb req-a90f1dae-4504-4e5c-92e1-cf35bc1e2e5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052047 Apr 12 03:32:48 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 58/171] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:49 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:49 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:49 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:49 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d2e9637f-5c2a-4934-bd18-0b659fc69a64 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 200 len: 2824 microversion: 2.42 time: 0.320212 Apr 12 03:32:49 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 56/172] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:48 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 2824 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f12ca7a8-7941-44c9-bd05-13c38023149c tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.136695 Apr 12 03:32:49 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 59/173] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:32:49 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4/os-interface => generated 1829 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:32:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-606964b0-7a57-4045-a2bb-bde14673e662 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 204 len: 0 microversion: 2.42 time: 0.134043 Apr 12 03:32:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 57/174] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:32:50 2023] DELETE /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c7d41578-7e45-4fdc-9392-52dfe140f69e tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 200 len: 1494 microversion: 2.1 time: 0.169576 Apr 12 03:32:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 59/175] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:32:50 2023] GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 1494 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:50 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7aeea82653d4681aa22f6dd8ae742b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d31bafe182459aa8bcb4f1bbb5e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-05bf5966-95df-4b40-a829-0bcefe2fdfd9 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 200 len: 2948 microversion: 2.42 time: 0.282302 Apr 12 03:32:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 60/176] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:50 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 2948 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-6b5755f1-551c-4d79-8fb2-6175b30952b4 req-adfb8c9c-ac7c-4f01-9c13-bcb1c56e975d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6b5755f1-551c-4d79-8fb2-6175b30952b4 req-adfb8c9c-ac7c-4f01-9c13-bcb1c56e975d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6b5755f1-551c-4d79-8fb2-6175b30952b4 req-adfb8c9c-ac7c-4f01-9c13-bcb1c56e975d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6b5755f1-551c-4d79-8fb2-6175b30952b4 req-adfb8c9c-ac7c-4f01-9c13-bcb1c56e975d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6b5755f1-551c-4d79-8fb2-6175b30952b4 req-adfb8c9c-ac7c-4f01-9c13-bcb1c56e975d service nova] Creating event network-vif-unplugged:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-6b5755f1-551c-4d79-8fb2-6175b30952b4 req-adfb8c9c-ac7c-4f01-9c13-bcb1c56e975d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042346 Apr 12 03:32:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 58/177] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-75b4cafc-acd3-4815-aff7-75bbc4e8463a req-1b76245b-c9e7-4633-981a-491c34b13693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "a1aaff41-e246-4887-89c6-a91163d4efd5"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-75b4cafc-acd3-4815-aff7-75bbc4e8463a req-1b76245b-c9e7-4633-981a-491c34b13693 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-75b4cafc-acd3-4815-aff7-75bbc4e8463a req-1b76245b-c9e7-4633-981a-491c34b13693 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-75b4cafc-acd3-4815-aff7-75bbc4e8463a req-1b76245b-c9e7-4633-981a-491c34b13693 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-75b4cafc-acd3-4815-aff7-75bbc4e8463a req-1b76245b-c9e7-4633-981a-491c34b13693 service nova] Creating event network-vif-unplugged:a1aaff41-e246-4887-89c6-a91163d4efd5 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-75b4cafc-acd3-4815-aff7-75bbc4e8463a req-1b76245b-c9e7-4633-981a-491c34b13693 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057424 Apr 12 03:32:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 60/178] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1a0a751b-e855-49e4-b63c-89f2f7ecbe91 req-5936891b-6072-448a-a064-c8cd2d04c333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "ac401bfa-a662-4290-af6e-0a39e8fde61c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a0a751b-e855-49e4-b63c-89f2f7ecbe91 req-5936891b-6072-448a-a064-c8cd2d04c333 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a0a751b-e855-49e4-b63c-89f2f7ecbe91 req-5936891b-6072-448a-a064-c8cd2d04c333 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a0a751b-e855-49e4-b63c-89f2f7ecbe91 req-5936891b-6072-448a-a064-c8cd2d04c333 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1a0a751b-e855-49e4-b63c-89f2f7ecbe91 req-5936891b-6072-448a-a064-c8cd2d04c333 service nova] Creating event network-vif-unplugged:ac401bfa-a662-4290-af6e-0a39e8fde61c for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1a0a751b-e855-49e4-b63c-89f2f7ecbe91 req-5936891b-6072-448a-a064-c8cd2d04c333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058470 Apr 12 03:32:51 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:52 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "835b5a2a-4d35-4d2a-9fdd-0c78b7def163"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "835b5a2a-4d35-4d2a-9fdd-0c78b7def163"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "4e57de22-e876-4bfe-bd07-a1003afd2295"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "4e57de22-e876-4bfe-bd07-a1003afd2295"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "21860860-2a08-43dc-bda8-0a1d0fab0634"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "21860860-2a08-43dc-bda8-0a1d0fab0634"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-plugged:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-unplugged:835b5a2a-4d35-4d2a-9fdd-0c78b7def163 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-plugged:835b5a2a-4d35-4d2a-9fdd-0c78b7def163 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-unplugged:4e57de22-e876-4bfe-bd07-a1003afd2295 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-plugged:4e57de22-e876-4bfe-bd07-a1003afd2295 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-unplugged:21860860-2a08-43dc-bda8-0a1d0fab0634 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] Creating event network-vif-plugged:21860860-2a08-43dc-bda8-0a1d0fab0634 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1a389d3e-5dd0-4eea-a1c1-103a997384e7 req-b9aec0b3-0483-44c6-89f2-dbc27bbb29dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.036544 Apr 12 03:32:52 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 59/180] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 03:32:52 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-6a0cc91e-b8d3-4139-bb9f-fcef19e24337 req-85107d92-2602-4adf-b31a-fc2b8b7d459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "a1aaff41-e246-4887-89c6-a91163d4efd5"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6a0cc91e-b8d3-4139-bb9f-fcef19e24337 req-85107d92-2602-4adf-b31a-fc2b8b7d459a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6a0cc91e-b8d3-4139-bb9f-fcef19e24337 req-85107d92-2602-4adf-b31a-fc2b8b7d459a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6a0cc91e-b8d3-4139-bb9f-fcef19e24337 req-85107d92-2602-4adf-b31a-fc2b8b7d459a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-6a0cc91e-b8d3-4139-bb9f-fcef19e24337 req-85107d92-2602-4adf-b31a-fc2b8b7d459a service nova] Creating event network-vif-plugged:a1aaff41-e246-4887-89c6-a91163d4efd5 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-6a0cc91e-b8d3-4139-bb9f-fcef19e24337 req-85107d92-2602-4adf-b31a-fc2b8b7d459a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054460 Apr 12 03:32:53 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 61/181] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:53 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "ac401bfa-a662-4290-af6e-0a39e8fde61c"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-unplugged", "status": "completed", "tag": "8248913f-46c8-4f3d-ab47-0203cb267169"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-plugged", "status": "completed", "tag": "8248913f-46c8-4f3d-ab47-0203cb267169"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Creating event network-vif-plugged:ac401bfa-a662-4290-af6e-0a39e8fde61c for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Creating event network-vif-unplugged:8248913f-46c8-4f3d-ab47-0203cb267169 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] Creating event network-vif-plugged:8248913f-46c8-4f3d-ab47-0203cb267169 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-26b842cd-51b1-4af6-808f-1f3e9197d8aa req-a2be10ab-11e0-4e1a-a780-0dcb41cf52f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.037518 Apr 12 03:32:53 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:53 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-359b0550-eaa2-4352-a586-b8434ea6ddb5 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.157301 Apr 12 03:32:53 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 62/183] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:32:53 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba/os-interface => generated 1827 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-74316767-22ef-4c1e-ae5e-4bd72ee1ec68 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 200 len: 2819 microversion: 2.32 time: 0.353544 Apr 12 03:32:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 62/184] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:54 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 2819 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b921dc4e-0bd3-4cc8-89fb-8492048f57d5 req-40f38e12-2494-452f-a5f6-d37423f96719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b921dc4e-0bd3-4cc8-89fb-8492048f57d5 req-40f38e12-2494-452f-a5f6-d37423f96719 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b921dc4e-0bd3-4cc8-89fb-8492048f57d5 req-40f38e12-2494-452f-a5f6-d37423f96719 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b921dc4e-0bd3-4cc8-89fb-8492048f57d5 req-40f38e12-2494-452f-a5f6-d37423f96719 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b921dc4e-0bd3-4cc8-89fb-8492048f57d5 req-40f38e12-2494-452f-a5f6-d37423f96719 service nova] Creating event network-changed:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b921dc4e-0bd3-4cc8-89fb-8492048f57d5 req-40f38e12-2494-452f-a5f6-d37423f96719 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061082 Apr 12 03:32:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 63/185] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:55 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-654d2e81-099b-49e8-bb64-e8be7bf98749 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1652 microversion: 2.20 time: 0.253227 Apr 12 03:32:55 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 61/186] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:54 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1652 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6d796401-971d-4878-9540-6770cc4f77e3 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.249893 Apr 12 03:32:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 63/187] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:32:55 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba/os-interface => generated 1827 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:32:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f35b64a0-0096-46a0-a92a-34c6d824acf1 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 204 len: 0 microversion: 2.32 time: 0.162500 Apr 12 03:32:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 64/188] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:32:56 2023] DELETE /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-e9fabb25-15f4-4d08-b3e8-49a8fbe72d15 req-ebea88c9-f1a6-4326-9a33-9956de8d3c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd29b6ed431d64bcab02c2348feab9aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd808e7e237f4c7490abaff5db0e3529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f1ba6294-70d0-48ca-b257-30623bc22bf6 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 200 len: 2944 microversion: 2.32 time: 0.357537 Apr 12 03:32:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 62/189] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:32:56 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 2944 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:32:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e9fabb25-15f4-4d08-b3e8-49a8fbe72d15 req-ebea88c9-f1a6-4326-9a33-9956de8d3c31 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e9fabb25-15f4-4d08-b3e8-49a8fbe72d15 req-ebea88c9-f1a6-4326-9a33-9956de8d3c31 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e9fabb25-15f4-4d08-b3e8-49a8fbe72d15 req-ebea88c9-f1a6-4326-9a33-9956de8d3c31 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-e9fabb25-15f4-4d08-b3e8-49a8fbe72d15 req-ebea88c9-f1a6-4326-9a33-9956de8d3c31 service nova] Creating event network-vif-unplugged:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-e9fabb25-15f4-4d08-b3e8-49a8fbe72d15 req-ebea88c9-f1a6-4326-9a33-9956de8d3c31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125163 Apr 12 03:32:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-2af93647-1628-45e6-a053-fb88713d94e1 req-6d76e04d-32cc-485e-8dfd-d24461e50f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "be3de447-6d22-4fec-b962-0ebe772ed86f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2af93647-1628-45e6-a053-fb88713d94e1 req-6d76e04d-32cc-485e-8dfd-d24461e50f4d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2af93647-1628-45e6-a053-fb88713d94e1 req-6d76e04d-32cc-485e-8dfd-d24461e50f4d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2af93647-1628-45e6-a053-fb88713d94e1 req-6d76e04d-32cc-485e-8dfd-d24461e50f4d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2af93647-1628-45e6-a053-fb88713d94e1 req-6d76e04d-32cc-485e-8dfd-d24461e50f4d service nova] Creating event network-vif-unplugged:be3de447-6d22-4fec-b962-0ebe772ed86f for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-2af93647-1628-45e6-a053-fb88713d94e1 req-6d76e04d-32cc-485e-8dfd-d24461e50f4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049665 Apr 12 03:32:57 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 65/191] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9b956faf-489d-4b34-8536-dec2a52ca186 req-bdadc14c-c0a6-45da-abd5-ebcef2b2fdb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "41626728-b21d-4ef8-9d86-5328d2feb3f9"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9b956faf-489d-4b34-8536-dec2a52ca186 req-bdadc14c-c0a6-45da-abd5-ebcef2b2fdb3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9b956faf-489d-4b34-8536-dec2a52ca186 req-bdadc14c-c0a6-45da-abd5-ebcef2b2fdb3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9b956faf-489d-4b34-8536-dec2a52ca186 req-bdadc14c-c0a6-45da-abd5-ebcef2b2fdb3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9b956faf-489d-4b34-8536-dec2a52ca186 req-bdadc14c-c0a6-45da-abd5-ebcef2b2fdb3 service nova] Creating event network-vif-unplugged:41626728-b21d-4ef8-9d86-5328d2feb3f9 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9b956faf-489d-4b34-8536-dec2a52ca186 req-bdadc14c-c0a6-45da-abd5-ebcef2b2fdb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045344 Apr 12 03:32:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 63/192] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-044b4bf4-df40-4681-8ebb-92fbc562cf65 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '.version_select at 0x7f76a70e9240>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-044b4bf4-df40-4681-8ebb-92fbc562cf65 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca" status: 200 len: 1723 microversion: 2.1 time: 0.087969 Apr 12 03:32:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 65/193] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 03:32:57 2023] GET /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca => generated 1723 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-68e718a9-91ae-4053-a807-fbcb97af7801 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '.version_select at 0x7f76a6e9b760>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-68e718a9-91ae-4053-a807-fbcb97af7801 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca" status: 200 len: 1723 microversion: 2.1 time: 0.087345 Apr 12 03:32:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 66/194] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 03:32:57 2023] GET /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca => generated 1723 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:58 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:32:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a7c5b3f9-abcb-4e29-aa16-8b100427b15f tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1670 microversion: 2.1 time: 0.604578 Apr 12 03:32:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 64/195] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:32:58 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1670 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "7740f806-8319-484b-8b0f-bffd8c5fe532"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "7740f806-8319-484b-8b0f-bffd8c5fe532"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "91177380-5d77-4bed-9ab0-e9085fcb3d5a"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "91177380-5d77-4bed-9ab0-e9085fcb3d5a"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "6bb0c89d-0a60-4413-b09d-08d4d6ea3a52"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Creating event network-vif-plugged:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Creating event network-vif-unplugged:7740f806-8319-484b-8b0f-bffd8c5fe532 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Creating event network-vif-plugged:7740f806-8319-484b-8b0f-bffd8c5fe532 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Creating event network-vif-unplugged:91177380-5d77-4bed-9ab0-e9085fcb3d5a for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Creating event network-vif-plugged:91177380-5d77-4bed-9ab0-e9085fcb3d5a for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] Creating event network-vif-unplugged:6bb0c89d-0a60-4413-b09d-08d4d6ea3a52 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-cc2614f4-e08e-47ae-8e9a-b3905bdf61ad req-7d58d6ea-4239-407a-9fa6-d0fc531d3435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.044749 Apr 12 03:32:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 66/196] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:59 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-d4891669-d6eb-4368-a1d1-7840d27e2e0c req-5079b151-59b8-4912-bc7f-b648fa1b5490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "be3de447-6d22-4fec-b962-0ebe772ed86f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d4891669-d6eb-4368-a1d1-7840d27e2e0c req-5079b151-59b8-4912-bc7f-b648fa1b5490 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d4891669-d6eb-4368-a1d1-7840d27e2e0c req-5079b151-59b8-4912-bc7f-b648fa1b5490 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d4891669-d6eb-4368-a1d1-7840d27e2e0c req-5079b151-59b8-4912-bc7f-b648fa1b5490 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-d4891669-d6eb-4368-a1d1-7840d27e2e0c req-5079b151-59b8-4912-bc7f-b648fa1b5490 service nova] Creating event network-vif-plugged:be3de447-6d22-4fec-b962-0ebe772ed86f for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-d4891669-d6eb-4368-a1d1-7840d27e2e0c req-5079b151-59b8-4912-bc7f-b648fa1b5490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Apr 12 03:32:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bbba6ebe-652d-4caf-ad0f-d42570bd53cf tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054005 Apr 12 03:32:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 65/198] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:59 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "41626728-b21d-4ef8-9d86-5328d2feb3f9"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-deleted", "tag": "8248913f-46c8-4f3d-ab47-0203cb267169"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-deleted", "tag": "ac401bfa-a662-4290-af6e-0a39e8fde61c"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-deleted", "tag": "ce9193f1-28a9-4c0f-95ae-e21f8140de19"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=79,nova_cell1:INSERT=5 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:32:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-65d16831-cf1c-4d1a-a01a-1392bac7decc tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056076 Apr 12 03:32:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:32:59 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Creating event network-vif-plugged:41626728-b21d-4ef8-9d86-5328d2feb3f9 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Creating event network-vif-deleted:8248913f-46c8-4f3d-ab47-0203cb267169 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Creating event network-vif-deleted:ac401bfa-a662-4290-af6e-0a39e8fde61c for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] Creating event network-vif-deleted:ce9193f1-28a9-4c0f-95ae-e21f8140de19 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:32:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-be796e52-4ccd-4612-aa2d-6b5b77f260d0 req-b8320e0a-7e80-4629-ab78-4d7d1fcd708f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038850 Apr 12 03:32:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 68/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:32:59 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:32:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:00 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lazy-loading 'services' on Instance uuid ccf9f424-d230-4079-87c5-bb08bc85b0b7 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:33:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bfcdec32-7a6e-481e-a6eb-9efb4c64fe06 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments/6a21ca3f-3f2d-48d7-a96c-c1f123ae3bb3" status: 202 len: 0 microversion: 2.1 time: 0.261986 Apr 12 03:33:00 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 66/201] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:32:59 2023] DELETE /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments/6a21ca3f-3f2d-48d7-a96c-c1f123ae3bb3 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-711ee546-e32d-4ba1-8ddb-8e8d41789e50 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Apr 12 03:33:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:33:00 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:33:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "6bb0c89d-0a60-4413-b09d-08d4d6ea3a52"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-unplugged", "status": "completed", "tag": "e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Creating event network-vif-plugged:6bb0c89d-0a60-4413-b09d-08d4d6ea3a52 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Creating event network-vif-unplugged:e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] Creating event network-vif-plugged:e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-5f330ef3-46b6-42b5-a64f-d84b7e3a9309 req-420b52ef-3fe8-436a-8ff3-91811be610db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038005 Apr 12 03:33:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 69/203] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:01 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-deleted", "tag": "4e57de22-e876-4bfe-bd07-a1003afd2295"}, {"server_uuid": "7119b8b3-291b-4868-820e-d7bd3dd3ada4", "name": "network-vif-deleted", "tag": "21860860-2a08-43dc-bda8-0a1d0fab0634"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:01 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] Creating event network-vif-deleted:4e57de22-e876-4bfe-bd07-a1003afd2295 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:33:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] Creating event network-vif-deleted:21860860-2a08-43dc-bda8-0a1d0fab0634 for instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 on user Apr 12 03:33:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-17d21e05-b6cc-4ff5-a5cc-475496ed6902 req-bff3b4af-7580-414f-9197-f5732ab0796c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045796 Apr 12 03:33:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 67/204] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:33:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-eb3a7d24-2385-4205-bc99-ffb6c7e82259 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a" status: 204 len: 0 microversion: 2.1 time: 0.119199 Apr 12 03:33:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 69/205] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:33:02 2023] DELETE /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1183761babfc4ba3b6f6febe28254c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b2bab30884740b8e6d2c268c7635b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a2d2c51c-e749-4bdb-96c5-22cea3ed01c9 tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a" status: 200 len: 1461 microversion: 2.1 time: 0.188433 Apr 12 03:33:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 70/206] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:02 2023] GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a => generated 1461 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-e10ac00c-ffa6-45b0-ab05-d1a2901a8c3a req-7309a805-9ac4-429c-8d27-e256b3609ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a0f3cf-1004-4ff9-9e41-d03291abbb9a", "name": "network-vif-unplugged", "status": "completed", "tag": "e9d42f8f-a0eb-4058-83e3-f5014b577443"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e10ac00c-ffa6-45b0-ab05-d1a2901a8c3a req-7309a805-9ac4-429c-8d27-e256b3609ab3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e10ac00c-ffa6-45b0-ab05-d1a2901a8c3a req-7309a805-9ac4-429c-8d27-e256b3609ab3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e10ac00c-ffa6-45b0-ab05-d1a2901a8c3a req-7309a805-9ac4-429c-8d27-e256b3609ab3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e10ac00c-ffa6-45b0-ab05-d1a2901a8c3a req-7309a805-9ac4-429c-8d27-e256b3609ab3 service nova] Creating event network-vif-unplugged:e9d42f8f-a0eb-4058-83e3-f5014b577443 for instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a on user Apr 12 03:33:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-e10ac00c-ffa6-45b0-ab05-d1a2901a8c3a req-7309a805-9ac4-429c-8d27-e256b3609ab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043430 Apr 12 03:33:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 68/207] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] HTTP exception thrown: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Request method failure captured: Apr 12 03:33:03 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d HTTP/1.1 Apr 12 03:33:03 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:33:03 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:33:03 user devstack@n-api.service[62074]: Connection: close Apr 12 03:33:03 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:33:03 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:33:03 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:33:03 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:33:03 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiXDlcMX5esouMeCGpqI9aCdH_cINYLzG2_xhFpv6UTbE2c0f9KuTw4Yp1r8FiUUPVfJRV6KWquP7DWHPxkWQvxn2ruFLBdTcne8LWzJi6qa_FyQHXzeBIr63zOYnEbsvZThUQxwmi9b9piIH9E2lkemHU4S1Y8imaQPfFw0noKjqmY Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Project-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Project-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5dadbf1b0a124d2d929c85bc2b916022"}]}] Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Tenant: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Tenant-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-User: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:03 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:33:03 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:33:03 user devstack@n-api.service[62074]: X-User-Id: 4d01e7aaa3734b299d0c0a27844011b4 Apr 12 03:33:03 user devstack@n-api.service[62074]: X-User-Name: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:03 user devstack@n-api.service[62074]: method: > Apr 12 03:33:03 user devstack@n-api.service[62074]: exception: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62074]: action_args: {'id': 'ef4ab4cb-6164-47ea-be1d-cbe0698f991d'} Apr 12 03:33:03 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Returning 404 to user: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6fb2a107-ef3b-4ae5-b1ce-a9f699bff3e7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 404 len: 111 microversion: 2.1 time: 0.038444 Apr 12 03:33:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 70/208] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:03 2023] GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-deleted", "tag": "33b2e7fb-520f-46d4-be86-e492aff77d4b"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-deleted", "tag": "91177380-5d77-4bed-9ab0-e9085fcb3d5a"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-deleted", "tag": "e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1"}, {"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-deleted", "tag": "6bb0c89d-0a60-4413-b09d-08d4d6ea3a52"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Creating event network-vif-deleted:33b2e7fb-520f-46d4-be86-e492aff77d4b for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Creating event network-vif-deleted:91177380-5d77-4bed-9ab0-e9085fcb3d5a for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Creating event network-vif-deleted:e16cfa52-5c5c-4ef1-bc6e-12fb5b7293b1 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] Creating event network-vif-deleted:6bb0c89d-0a60-4413-b09d-08d4d6ea3a52 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c0c039af-fc2f-4f1a-a10c-885e47fc860f req-47d3e1c8-b588-4343-90ff-cef6ffa7f7b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.034539 Apr 12 03:33:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 71/209] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] HTTP exception thrown: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Request method failure captured: Apr 12 03:33:03 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d/os-volume_attachments HTTP/1.1 Apr 12 03:33:03 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:33:03 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:33:03 user devstack@n-api.service[62073]: Connection: close Apr 12 03:33:03 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:33:03 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:33:03 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:33:03 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:33:03 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiXDlcMX5esouMeCGpqI9aCdH_cINYLzG2_xhFpv6UTbE2c0f9KuTw4Yp1r8FiUUPVfJRV6KWquP7DWHPxkWQvxn2ruFLBdTcne8LWzJi6qa_FyQHXzeBIr63zOYnEbsvZThUQxwmi9b9piIH9E2lkemHU4S1Y8imaQPfFw0noKjqmY Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Project-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Project-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5dadbf1b0a124d2d929c85bc2b916022"}]}] Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Tenant: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Tenant-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-User: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:03 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:33:03 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:33:03 user devstack@n-api.service[62073]: X-User-Id: 4d01e7aaa3734b299d0c0a27844011b4 Apr 12 03:33:03 user devstack@n-api.service[62073]: X-User-Name: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:03 user devstack@n-api.service[62073]: method: > Apr 12 03:33:03 user devstack@n-api.service[62073]: exception: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62073]: action_args: {'server_id': 'ef4ab4cb-6164-47ea-be1d-cbe0698f991d'} Apr 12 03:33:03 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Returning 404 to user: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-243a7678-1def-4b14-9227-2b78a1268fb5 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037655 Apr 12 03:33:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 69/210] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:33:03 2023] GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-2957a348-4d7b-481c-82c6-3e46aa5eaae4 req-4406de4e-6601-4263-9a2f-698aaac1ffdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a0f3cf-1004-4ff9-9e41-d03291abbb9a", "name": "network-vif-plugged", "status": "completed", "tag": "e9d42f8f-a0eb-4058-83e3-f5014b577443"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2957a348-4d7b-481c-82c6-3e46aa5eaae4 req-4406de4e-6601-4263-9a2f-698aaac1ffdb service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2957a348-4d7b-481c-82c6-3e46aa5eaae4 req-4406de4e-6601-4263-9a2f-698aaac1ffdb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2957a348-4d7b-481c-82c6-3e46aa5eaae4 req-4406de4e-6601-4263-9a2f-698aaac1ffdb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2957a348-4d7b-481c-82c6-3e46aa5eaae4 req-4406de4e-6601-4263-9a2f-698aaac1ffdb service nova] Creating event network-vif-plugged:e9d42f8f-a0eb-4058-83e3-f5014b577443 for instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a on user Apr 12 03:33:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-2957a348-4d7b-481c-82c6-3e46aa5eaae4 req-4406de4e-6601-4263-9a2f-698aaac1ffdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030093 Apr 12 03:33:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 71/211] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43289ac5-3300-4e1f-8d07-2d66ee78e7ba", "name": "network-vif-deleted", "tag": "41626728-b21d-4ef8-9d86-5328d2feb3f9"}, {"server_uuid": "f1a0f3cf-1004-4ff9-9e41-d03291abbb9a", "name": "network-vif-deleted", "tag": "e9d42f8f-a0eb-4058-83e3-f5014b577443"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] Creating event network-vif-deleted:41626728-b21d-4ef8-9d86-5328d2feb3f9 for instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba on user Apr 12 03:33:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] Creating event network-vif-deleted:e9d42f8f-a0eb-4058-83e3-f5014b577443 for instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a on user Apr 12 03:33:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-338f3719-3a28-47e8-b520-0c18e198289f req-448781e1-1270-4aa5-b761-1a96fee425d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042843 Apr 12 03:33:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] HTTP exception thrown: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Request method failure captured: Apr 12 03:33:06 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d HTTP/1.1 Apr 12 03:33:06 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:33:06 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:33:06 user devstack@n-api.service[62073]: Connection: close Apr 12 03:33:06 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:33:06 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:33:06 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:33:06 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:33:06 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiXDlcMX5esouMeCGpqI9aCdH_cINYLzG2_xhFpv6UTbE2c0f9KuTw4Yp1r8FiUUPVfJRV6KWquP7DWHPxkWQvxn2ruFLBdTcne8LWzJi6qa_FyQHXzeBIr63zOYnEbsvZThUQxwmi9b9piIH9E2lkemHU4S1Y8imaQPfFw0noKjqmY Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Project-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Project-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5dadbf1b0a124d2d929c85bc2b916022"}]}] Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Tenant: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Tenant-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-User: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:06 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:33:06 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:33:06 user devstack@n-api.service[62073]: X-User-Id: 4d01e7aaa3734b299d0c0a27844011b4 Apr 12 03:33:06 user devstack@n-api.service[62073]: X-User-Name: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:06 user devstack@n-api.service[62073]: method: > Apr 12 03:33:06 user devstack@n-api.service[62073]: exception: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62073]: action_args: {'id': 'ef4ab4cb-6164-47ea-be1d-cbe0698f991d'} Apr 12 03:33:06 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Returning 404 to user: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-df739119-3467-42a8-b56f-5deea86920d7 tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 404 len: 111 microversion: 2.1 time: 0.029938 Apr 12 03:33:06 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 70/213] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:33:06 2023] DELETE /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] [instance: ef4ab4cb-6164-47ea-be1d-cbe0698f991d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] HTTP exception thrown: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Request method failure captured: Apr 12 03:33:06 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d HTTP/1.1 Apr 12 03:33:06 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:33:06 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:33:06 user devstack@n-api.service[62074]: Connection: close Apr 12 03:33:06 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:33:06 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:33:06 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:33:06 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:33:06 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiXDlcMX5esouMeCGpqI9aCdH_cINYLzG2_xhFpv6UTbE2c0f9KuTw4Yp1r8FiUUPVfJRV6KWquP7DWHPxkWQvxn2ruFLBdTcne8LWzJi6qa_FyQHXzeBIr63zOYnEbsvZThUQxwmi9b9piIH9E2lkemHU4S1Y8imaQPfFw0noKjqmY Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Project-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Project-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5dadbf1b0a124d2d929c85bc2b916022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5dadbf1b0a124d2d929c85bc2b916022"}]}] Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Tenant: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Tenant-Id: 5dadbf1b0a124d2d929c85bc2b916022 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-DeleteServersTestJSON-78784513 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-User: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:06 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:33:06 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:33:06 user devstack@n-api.service[62074]: X-User-Id: 4d01e7aaa3734b299d0c0a27844011b4 Apr 12 03:33:06 user devstack@n-api.service[62074]: X-User-Name: tempest-DeleteServersTestJSON-78784513-project-member Apr 12 03:33:06 user devstack@n-api.service[62074]: method: > Apr 12 03:33:06 user devstack@n-api.service[62074]: exception: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62074]: action_args: {'id': 'ef4ab4cb-6164-47ea-be1d-cbe0698f991d'} Apr 12 03:33:06 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. Apr 12 03:33:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] Returning 404 to user: Instance ef4ab4cb-6164-47ea-be1d-cbe0698f991d could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f853555f-1db1-4349-bff6-114187ca306e tempest-DeleteServersTestJSON-78784513 tempest-DeleteServersTestJSON-78784513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d" status: 404 len: 111 microversion: 2.1 time: 0.032808 Apr 12 03:33:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 72/214] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:06 2023] GET /compute/v2.1/servers/ef4ab4cb-6164-47ea-be1d-cbe0698f991d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-206381688", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:08 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] validate_networks() for [('f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for user d99be569057f432484e4a60b46882bbd and project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:33:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:33:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a222a645-4969-4047-a1e7-07b9724c7097 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.582042 Apr 12 03:33:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 73/215] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:33:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:33:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f19becac-5524-4cf2-9c28-0bd29efefd6c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f19becac-5524-4cf2-9c28-0bd29efefd6c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:09 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f19becac-5524-4cf2-9c28-0bd29efefd6c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:09 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f19becac-5524-4cf2-9c28-0bd29efefd6c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:09 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f19becac-5524-4cf2-9c28-0bd29efefd6c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f19becac-5524-4cf2-9c28-0bd29efefd6c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1394 microversion: 2.87 time: 0.088655 Apr 12 03:33:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 71/216] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:09 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1394 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:33:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:09 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:09 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:10 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:10 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lazy-loading 'services' on Instance uuid cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:33:10 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f1b931c0-7a5f-4ab1-8fd4-effb8e685208 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0/os-volume_attachments/263426d6-d387-4a67-9013-5a23e8386c93" status: 202 len: 0 microversion: 2.1 time: 0.306516 Apr 12 03:33:10 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 73/217] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:33:09 2023] DELETE /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0/os-volume_attachments/263426d6-d387-4a67-9013-5a23e8386c93 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:10 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:33:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1f61389b-b0a8-4efc-bc89-bddbee2d27ce tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0" status: 204 len: 0 microversion: 2.1 time: 0.131218 Apr 12 03:33:10 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 74/218] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:33:10 2023] DELETE /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:10 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84ea3a8776a944178ba5a04bce4d9b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f7b42b161f41efb234f0ce70210a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a7d9cc7b-6a5f-4b9e-9eef-6e7773922333 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0" status: 200 len: 1548 microversion: 2.1 time: 0.228447 Apr 12 03:33:10 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 72/219] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:10 2023] GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:33:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-30ee4f79-6a71-4b3d-80a5-53f87002dea4 req-f9b535a3-6362-4ca8-9373-5e2e4c059422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-30ee4f79-6a71-4b3d-80a5-53f87002dea4 req-f9b535a3-6362-4ca8-9373-5e2e4c059422 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-30ee4f79-6a71-4b3d-80a5-53f87002dea4 req-f9b535a3-6362-4ca8-9373-5e2e4c059422 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-30ee4f79-6a71-4b3d-80a5-53f87002dea4 req-f9b535a3-6362-4ca8-9373-5e2e4c059422 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-30ee4f79-6a71-4b3d-80a5-53f87002dea4 req-f9b535a3-6362-4ca8-9373-5e2e4c059422 service nova] Creating event network-changed:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:33:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-30ee4f79-6a71-4b3d-80a5-53f87002dea4 req-f9b535a3-6362-4ca8-9373-5e2e4c059422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028234 Apr 12 03:33:11 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 74/220] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0", "name": "network-vif-unplugged", "status": "completed", "tag": "91c0bcc3-17a9-4444-bb3c-715e45188260"}, {"server_uuid": "cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0", "name": "network-vif-plugged", "status": "completed", "tag": "91c0bcc3-17a9-4444-bb3c-715e45188260"}, {"server_uuid": "cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0", "name": "network-vif-deleted", "tag": "91c0bcc3-17a9-4444-bb3c-715e45188260"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Creating event network-vif-unplugged:91c0bcc3-17a9-4444-bb3c-715e45188260 for instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 on user Apr 12 03:33:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Creating event network-vif-plugged:91c0bcc3-17a9-4444-bb3c-715e45188260 for instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 on user Apr 12 03:33:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] Creating event network-vif-deleted:91c0bcc3-17a9-4444-bb3c-715e45188260 for instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 on user Apr 12 03:33:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-e2d7f937-854b-4e1e-9bb5-cd956a00ef1c req-e81671b2-5f59-4431-a138-4fdc94594fba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032856 Apr 12 03:33:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:16 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9bd49d30-dee6-4b7d-ac81-5d6f44c0ec13 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'create', calling method: .version_select at 0x7f76a6b1f9a0>, body: {"keypair": {"name": "tempest-keypair-364276420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmrI9wy1CUIwhlKuXvzk0mD7Pt5nZFvI1CsqS0do6Lk76JQOvGl5lvx9rkz7UAM9WGocGXyWSOUOuKTtYZRD2HqKUbTN4VPOoliE1yuu+s0lx7vuZu45Mj7wDb2S8Ksyw=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:16 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:16 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-9bd49d30-dee6-4b7d-ac81-5d6f44c0ec13 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:33:16 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-9bd49d30-dee6-4b7d-ac81-5d6f44c0ec13 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:33:16 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9bd49d30-dee6-4b7d-ac81-5d6f44c0ec13 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185795 Apr 12 03:33:16 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 73/222] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:33:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2050314981", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9cac7f86-c0da-4b81-bdde-50662f79d265"}], "security_groups": [{"name": "tempest-securitygroup--1184528712"}], "key_name": "tempest-keypair-364276420", "user_data": "}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] validate_networks() for [('9cac7f86-c0da-4b81-bdde-50662f79d265', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:33:18 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:33:18 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f2c7053e-f685-410c-a30a-7d7b9cbda009 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.637645 Apr 12 03:33:18 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 75/223] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:33:18 2023] POST /compute/v2.1/servers => generated 407 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:33:18 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f6b9dfcb-31be-42ce-9a73-248891598739 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:18 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f6b9dfcb-31be-42ce-9a73-248891598739 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:18 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-f6b9dfcb-31be-42ce-9a73-248891598739 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:18 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f6b9dfcb-31be-42ce-9a73-248891598739 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1232 microversion: 2.1 time: 0.071492 Apr 12 03:33:18 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:18 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1232 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:33:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b12f432e-10d7-48c6-9724-63b8bf916e71 req-7d53bac5-10fd-4fc9-859c-a30f42960137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:21 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b12f432e-10d7-48c6-9724-63b8bf916e71 req-7d53bac5-10fd-4fc9-859c-a30f42960137 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b12f432e-10d7-48c6-9724-63b8bf916e71 req-7d53bac5-10fd-4fc9-859c-a30f42960137 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b12f432e-10d7-48c6-9724-63b8bf916e71 req-7d53bac5-10fd-4fc9-859c-a30f42960137 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b12f432e-10d7-48c6-9724-63b8bf916e71 req-7d53bac5-10fd-4fc9-859c-a30f42960137 service nova] Creating event network-changed:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:33:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b12f432e-10d7-48c6-9724-63b8bf916e71 req-7d53bac5-10fd-4fc9-859c-a30f42960137 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032366 Apr 12 03:33:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 74/225] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-07bc84c9-54bd-453c-a59e-b503fa73a6dd req-0776835a-623e-4af8-962d-deaf3b2f684f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-07bc84c9-54bd-453c-a59e-b503fa73a6dd req-0776835a-623e-4af8-962d-deaf3b2f684f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-07bc84c9-54bd-453c-a59e-b503fa73a6dd req-0776835a-623e-4af8-962d-deaf3b2f684f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-07bc84c9-54bd-453c-a59e-b503fa73a6dd req-0776835a-623e-4af8-962d-deaf3b2f684f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-07bc84c9-54bd-453c-a59e-b503fa73a6dd req-0776835a-623e-4af8-962d-deaf3b2f684f service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:33:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-07bc84c9-54bd-453c-a59e-b503fa73a6dd req-0776835a-623e-4af8-962d-deaf3b2f684f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039282 Apr 12 03:33:24 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:24 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-7b21611b-2012-45f4-8b5e-b42629b184c1 req-2f190fac-c436-41ec-ab50-6e1d49e214fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:24 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:24 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7b21611b-2012-45f4-8b5e-b42629b184c1 req-2f190fac-c436-41ec-ab50-6e1d49e214fa service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7b21611b-2012-45f4-8b5e-b42629b184c1 req-2f190fac-c436-41ec-ab50-6e1d49e214fa service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7b21611b-2012-45f4-8b5e-b42629b184c1 req-2f190fac-c436-41ec-ab50-6e1d49e214fa service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-7b21611b-2012-45f4-8b5e-b42629b184c1 req-2f190fac-c436-41ec-ab50-6e1d49e214fa service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:33:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-7b21611b-2012-45f4-8b5e-b42629b184c1 req-2f190fac-c436-41ec-ab50-6e1d49e214fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077811 Apr 12 03:33:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 77/227] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d3f92bbf-0ba5-4b00-85e3-0df5cec92e70 req-ccd309e2-8182-4b68-97aa-cff5916aaa24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d3f92bbf-0ba5-4b00-85e3-0df5cec92e70 req-ccd309e2-8182-4b68-97aa-cff5916aaa24 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d3f92bbf-0ba5-4b00-85e3-0df5cec92e70 req-ccd309e2-8182-4b68-97aa-cff5916aaa24 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d3f92bbf-0ba5-4b00-85e3-0df5cec92e70 req-ccd309e2-8182-4b68-97aa-cff5916aaa24 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d3f92bbf-0ba5-4b00-85e3-0df5cec92e70 req-ccd309e2-8182-4b68-97aa-cff5916aaa24 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:33:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d3f92bbf-0ba5-4b00-85e3-0df5cec92e70 req-ccd309e2-8182-4b68-97aa-cff5916aaa24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 Apr 12 03:33:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 75/228] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-71876623-dd14-4cb6-8556-cd30033c366f req-954c2c5c-a43d-4472-9128-d1fbc36843a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-71876623-dd14-4cb6-8556-cd30033c366f req-954c2c5c-a43d-4472-9128-d1fbc36843a1 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-71876623-dd14-4cb6-8556-cd30033c366f req-954c2c5c-a43d-4472-9128-d1fbc36843a1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-71876623-dd14-4cb6-8556-cd30033c366f req-954c2c5c-a43d-4472-9128-d1fbc36843a1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-71876623-dd14-4cb6-8556-cd30033c366f req-954c2c5c-a43d-4472-9128-d1fbc36843a1 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:33:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-71876623-dd14-4cb6-8556-cd30033c366f req-954c2c5c-a43d-4472-9128-d1fbc36843a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029388 Apr 12 03:33:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] HTTP exception thrown: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Request method failure captured: Apr 12 03:33:32 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 HTTP/1.1 Apr 12 03:33:32 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:33:32 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:33:32 user devstack@n-api.service[62072]: Connection: close Apr 12 03:33:32 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:33:32 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:33:32 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:33:32 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:33:32 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiXCTnpsPaFVnalxsxCTO5Mx2hpgrPbjiQQuU7GGhfZWEHAC8X9IKyYLnsjGUYpkT0kqaQ1rkVGAdeS0MMpbCWCwoU252yKpO16_s_YOvKLSpfp4vt8xVvznKUzJ_MeqLICmRKQswsuVeMjTMMWBLjl0uCx2NlquXdAh0GACebb4UZI Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Project-Id: 90a92643aee44b66864aa10c2cf6f048 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90a92643aee44b66864aa10c2cf6f048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90a92643aee44b66864aa10c2cf6f048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90a92643aee44b66864aa10c2cf6f048"}]}] Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Tenant-Id: 90a92643aee44b66864aa10c2cf6f048 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-User: tempest-AttachSCSIVolumeTestJSON-95582294-project-member Apr 12 03:33:32 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:33:32 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:33:32 user devstack@n-api.service[62072]: X-User-Id: 431c372c4da24fa692f43f2d16764755 Apr 12 03:33:32 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-95582294-project-member Apr 12 03:33:32 user devstack@n-api.service[62072]: method: > Apr 12 03:33:32 user devstack@n-api.service[62072]: exception: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:32 user devstack@n-api.service[62072]: action_args: {'id': '413850ca-8175-4ed6-a6cf-ff42230fa1e0'} Apr 12 03:33:32 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Returning 404 to user: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a9a17d1a-f311-424a-b9c0-6da7899de576 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 404 len: 111 microversion: 2.1 time: 0.035288 Apr 12 03:33:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:32 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:33 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:33 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ebd66c38-f3a9-4145-945c-d5325d859725 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '.version_select at 0x7f76a6b79b40>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ebd66c38-f3a9-4145-945c-d5325d859725 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539207312" status: 202 len: 0 microversion: 2.1 time: 0.028676 Apr 12 03:33:33 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 76/231] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:33:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539207312 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:36 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] HTTP exception thrown: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Request method failure captured: Apr 12 03:33:36 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 HTTP/1.1 Apr 12 03:33:36 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:33:36 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:33:36 user devstack@n-api.service[62074]: Connection: close Apr 12 03:33:36 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:33:36 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:33:36 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:33:36 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:33:36 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiXCTnpsPaFVnalxsxCTO5Mx2hpgrPbjiQQuU7GGhfZWEHAC8X9IKyYLnsjGUYpkT0kqaQ1rkVGAdeS0MMpbCWCwoU252yKpO16_s_YOvKLSpfp4vt8xVvznKUzJ_MeqLICmRKQswsuVeMjTMMWBLjl0uCx2NlquXdAh0GACebb4UZI Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Project-Id: 90a92643aee44b66864aa10c2cf6f048 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90a92643aee44b66864aa10c2cf6f048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90a92643aee44b66864aa10c2cf6f048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90a92643aee44b66864aa10c2cf6f048"}]}] Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Tenant-Id: 90a92643aee44b66864aa10c2cf6f048 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-User: tempest-AttachSCSIVolumeTestJSON-95582294-project-member Apr 12 03:33:36 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:33:36 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:33:36 user devstack@n-api.service[62074]: X-User-Id: 431c372c4da24fa692f43f2d16764755 Apr 12 03:33:36 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-95582294-project-member Apr 12 03:33:36 user devstack@n-api.service[62074]: method: > Apr 12 03:33:36 user devstack@n-api.service[62074]: exception: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62074]: action_args: {'id': '413850ca-8175-4ed6-a6cf-ff42230fa1e0'} Apr 12 03:33:36 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Returning 404 to user: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:36 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-bcf63fc1-0c88-4dd7-b6da-36a2f8e26b29 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 404 len: 111 microversion: 2.1 time: 0.030907 Apr 12 03:33:36 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:33:36 2023] DELETE /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] [instance: 413850ca-8175-4ed6-a6cf-ff42230fa1e0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] HTTP exception thrown: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Request method failure captured: Apr 12 03:33:36 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 HTTP/1.1 Apr 12 03:33:36 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:33:36 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:33:36 user devstack@n-api.service[62072]: Connection: close Apr 12 03:33:36 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:33:36 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:33:36 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:33:36 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:33:36 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiXCTnpsPaFVnalxsxCTO5Mx2hpgrPbjiQQuU7GGhfZWEHAC8X9IKyYLnsjGUYpkT0kqaQ1rkVGAdeS0MMpbCWCwoU252yKpO16_s_YOvKLSpfp4vt8xVvznKUzJ_MeqLICmRKQswsuVeMjTMMWBLjl0uCx2NlquXdAh0GACebb4UZI Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Project-Id: 90a92643aee44b66864aa10c2cf6f048 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90a92643aee44b66864aa10c2cf6f048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90a92643aee44b66864aa10c2cf6f048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90a92643aee44b66864aa10c2cf6f048"}]}] Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Tenant-Id: 90a92643aee44b66864aa10c2cf6f048 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-95582294 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-User: tempest-AttachSCSIVolumeTestJSON-95582294-project-member Apr 12 03:33:36 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:33:36 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:33:36 user devstack@n-api.service[62072]: X-User-Id: 431c372c4da24fa692f43f2d16764755 Apr 12 03:33:36 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-95582294-project-member Apr 12 03:33:36 user devstack@n-api.service[62072]: method: > Apr 12 03:33:36 user devstack@n-api.service[62072]: exception: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62072]: action_args: {'id': '413850ca-8175-4ed6-a6cf-ff42230fa1e0'} Apr 12 03:33:36 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. Apr 12 03:33:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] Returning 404 to user: Instance 413850ca-8175-4ed6-a6cf-ff42230fa1e0 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-79872972-c864-44f8-84e6-e54e8a77e1d5 tempest-AttachSCSIVolumeTestJSON-95582294 tempest-AttachSCSIVolumeTestJSON-95582294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0" status: 404 len: 111 microversion: 2.1 time: 0.031546 Apr 12 03:33:36 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:36 2023] GET /compute/v2.1/servers/413850ca-8175-4ed6-a6cf-ff42230fa1e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] HTTP exception thrown: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Request method failure captured: Apr 12 03:33:40 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 HTTP/1.1 Apr 12 03:33:40 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:33:40 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:33:40 user devstack@n-api.service[62073]: Connection: close Apr 12 03:33:40 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:33:40 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:33:40 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:33:40 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:33:40 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW1XUZ8ubPDI7xv30xJnH27RRU4WpEjpHfWuG14EjXvBiZnjw3IWDhiJghfJna7cAmmvKwitfrd8b_NOIuC1v1_F__x63Q56ImirwwPo7c0oJjHlUbUuyxRyS300fwrkJgBn30dTYnWG2qyMxWoYwcK5B3olRlqUUg0Zb1d3-1tylA Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Project-Id: 72d31bafe182459aa8bcb4f1bbb5e6d0 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}] Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Tenant: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Tenant-Id: 72d31bafe182459aa8bcb4f1bbb5e6d0 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-User: tempest-TaggedBootDevicesTest_v242-294347777-project-member Apr 12 03:33:40 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:33:40 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:33:40 user devstack@n-api.service[62073]: X-User-Id: e7aeea82653d4681aa22f6dd8ae742b4 Apr 12 03:33:40 user devstack@n-api.service[62073]: X-User-Name: tempest-TaggedBootDevicesTest_v242-294347777-project-member Apr 12 03:33:40 user devstack@n-api.service[62073]: method: > Apr 12 03:33:40 user devstack@n-api.service[62073]: exception: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:40 user devstack@n-api.service[62073]: action_args: {'id': '7119b8b3-291b-4868-820e-d7bd3dd3ada4'} Apr 12 03:33:40 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Returning 404 to user: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bdfe1cfb-45bd-47c1-b787-4803e1f0818e tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 404 len: 111 microversion: 2.42 time: 0.039781 Apr 12 03:33:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 77/234] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:40 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:33:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f907916c-0e29-49a4-8ed0-228d83135d0d tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '.version_select at 0x7f76a6c1a9e0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:40 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f907916c-0e29-49a4-8ed0-228d83135d0d tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476892975" status: 204 len: 0 microversion: 2.42 time: 0.028821 Apr 12 03:33:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 79/235] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 03:33:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476892975 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:44 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] HTTP exception thrown: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Request method failure captured: Apr 12 03:33:44 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 HTTP/1.1 Apr 12 03:33:44 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:33:44 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:33:44 user devstack@n-api.service[62072]: Connection: close Apr 12 03:33:44 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:33:44 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:33:44 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:33:44 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:33:44 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW1XUZ8ubPDI7xv30xJnH27RRU4WpEjpHfWuG14EjXvBiZnjw3IWDhiJghfJna7cAmmvKwitfrd8b_NOIuC1v1_F__x63Q56ImirwwPo7c0oJjHlUbUuyxRyS300fwrkJgBn30dTYnWG2qyMxWoYwcK5B3olRlqUUg0Zb1d3-1tylA Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Project-Id: 72d31bafe182459aa8bcb4f1bbb5e6d0 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}] Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Tenant: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Tenant-Id: 72d31bafe182459aa8bcb4f1bbb5e6d0 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-User: tempest-TaggedBootDevicesTest_v242-294347777-project-member Apr 12 03:33:44 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:33:44 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:33:44 user devstack@n-api.service[62072]: X-User-Id: e7aeea82653d4681aa22f6dd8ae742b4 Apr 12 03:33:44 user devstack@n-api.service[62072]: X-User-Name: tempest-TaggedBootDevicesTest_v242-294347777-project-member Apr 12 03:33:44 user devstack@n-api.service[62072]: method: > Apr 12 03:33:44 user devstack@n-api.service[62072]: exception: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62072]: action_args: {'id': '7119b8b3-291b-4868-820e-d7bd3dd3ada4'} Apr 12 03:33:44 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Returning 404 to user: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:44 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-25bcac8a-37d0-4371-ba9b-769be8ec6c05 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 404 len: 111 microversion: 2.42 time: 0.035841 Apr 12 03:33:44 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 80/236] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:33:44 2023] DELETE /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] [instance: 7119b8b3-291b-4868-820e-d7bd3dd3ada4] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] HTTP exception thrown: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Request method failure captured: Apr 12 03:33:44 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 HTTP/1.1 Apr 12 03:33:44 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:33:44 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:33:44 user devstack@n-api.service[62073]: Connection: close Apr 12 03:33:44 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:33:44 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:33:44 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:33:44 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:33:44 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW1XUZ8ubPDI7xv30xJnH27RRU4WpEjpHfWuG14EjXvBiZnjw3IWDhiJghfJna7cAmmvKwitfrd8b_NOIuC1v1_F__x63Q56ImirwwPo7c0oJjHlUbUuyxRyS300fwrkJgBn30dTYnWG2qyMxWoYwcK5B3olRlqUUg0Zb1d3-1tylA Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Project-Id: 72d31bafe182459aa8bcb4f1bbb5e6d0 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d31bafe182459aa8bcb4f1bbb5e6d0"}]}] Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Tenant: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Tenant-Id: 72d31bafe182459aa8bcb4f1bbb5e6d0 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-294347777 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-User: tempest-TaggedBootDevicesTest_v242-294347777-project-member Apr 12 03:33:44 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:33:44 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:33:44 user devstack@n-api.service[62073]: X-User-Id: e7aeea82653d4681aa22f6dd8ae742b4 Apr 12 03:33:44 user devstack@n-api.service[62073]: X-User-Name: tempest-TaggedBootDevicesTest_v242-294347777-project-member Apr 12 03:33:44 user devstack@n-api.service[62073]: method: > Apr 12 03:33:44 user devstack@n-api.service[62073]: exception: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62073]: action_args: {'id': '7119b8b3-291b-4868-820e-d7bd3dd3ada4'} Apr 12 03:33:44 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. Apr 12 03:33:44 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:33:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] Returning 404 to user: Instance 7119b8b3-291b-4868-820e-d7bd3dd3ada4 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-85bd34e3-d79c-4ec2-b224-aa0ea0847f02 tempest-TaggedBootDevicesTest_v242-294347777 tempest-TaggedBootDevicesTest_v242-294347777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4" status: 404 len: 111 microversion: 2.42 time: 0.032880 Apr 12 03:33:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 78/237] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:44 2023] GET /compute/v2.1/servers/7119b8b3-291b-4868-820e-d7bd3dd3ada4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] HTTP exception thrown: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Request method failure captured: Apr 12 03:33:47 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba HTTP/1.1 Apr 12 03:33:47 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:33:47 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:33:47 user devstack@n-api.service[62074]: Connection: close Apr 12 03:33:47 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:33:47 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:33:47 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:33:47 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:33:47 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW68z0e73GTjPHL0k8AAMrW923p_FG1XzJCi3eTX39p_vdQCjkH9lMUbEL1tC3Dsx3s-uUP0hEznK-Cph3nM_SxCfaB-gLOYpRfKJT9eAw-Rh08_AXFszO03RLJyRsPHOA-p9_3nrEPHYeGw9-hKJTWzWxjUXoS-hZ6EvaA32FHQVQ Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Project-Id: bd808e7e237f4c7490abaff5db0e3529 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Project-Name: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd808e7e237f4c7490abaff5db0e3529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd808e7e237f4c7490abaff5db0e3529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd808e7e237f4c7490abaff5db0e3529"}]}] Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Tenant: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Tenant-Id: bd808e7e237f4c7490abaff5db0e3529 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-User: tempest-TaggedBootDevicesTest-1194851633-project-member Apr 12 03:33:47 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:33:47 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:33:47 user devstack@n-api.service[62074]: X-User-Id: d29b6ed431d64bcab02c2348feab9aa6 Apr 12 03:33:47 user devstack@n-api.service[62074]: X-User-Name: tempest-TaggedBootDevicesTest-1194851633-project-member Apr 12 03:33:47 user devstack@n-api.service[62074]: method: > Apr 12 03:33:47 user devstack@n-api.service[62074]: exception: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:47 user devstack@n-api.service[62074]: action_args: {'id': '43289ac5-3300-4e1f-8d07-2d66ee78e7ba'} Apr 12 03:33:47 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Returning 404 to user: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-463789a3-5a41-49a0-a74c-3b4e1254e606 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 404 len: 111 microversion: 2.32 time: 0.038921 Apr 12 03:33:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 80/238] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:47 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:33:47 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-bbd29fe0-e104-4366-9c03-2857722ba1d7 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '.version_select at 0x7f76a6b8e050>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-bbd29fe0-e104-4366-9c03-2857722ba1d7 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115967448" status: 204 len: 0 microversion: 2.32 time: 0.029646 Apr 12 03:33:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 81/239] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 03:33:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115967448 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4e62af33-47dd-447a-8624-a4bc85ee6ce0 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047043 Apr 12 03:33:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:33:50 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:33:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-75ed2f54-4130-4825-b365-c332ad47aa70 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7" status: 204 len: 0 microversion: 2.1 time: 0.138571 Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:33:50 2023] DELETE /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:33:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-798ab535-edb2-4c89-9681-17974df2211f tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 204 len: 0 microversion: 2.1 time: 0.140600 Apr 12 03:33:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 82/242] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:33:50 2023] DELETE /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fd9f0996bd48628564e6c170c11a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51faa215a1546fbaa0db25c9773ba6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f069ed14-0f35-49bd-92e8-0e6631faf43d tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7" status: 200 len: 1648 microversion: 2.1 time: 0.365818 Apr 12 03:33:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:50 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7 => generated 1648 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:33:50 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6405c4bb-9437-422a-91ba-dcf41d2ba0ff tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 200 len: 1500 microversion: 2.1 time: 0.262561 Apr 12 03:33:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:50 2023] GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 1500 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b8695159-1b4c-402e-a54d-75880362b2fa req-9869c277-12a0-4031-821d-5bb28e6c05cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-unplugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b8695159-1b4c-402e-a54d-75880362b2fa req-9869c277-12a0-4031-821d-5bb28e6c05cc service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b8695159-1b4c-402e-a54d-75880362b2fa req-9869c277-12a0-4031-821d-5bb28e6c05cc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b8695159-1b4c-402e-a54d-75880362b2fa req-9869c277-12a0-4031-821d-5bb28e6c05cc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b8695159-1b4c-402e-a54d-75880362b2fa req-9869c277-12a0-4031-821d-5bb28e6c05cc service nova] Creating event network-vif-unplugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b8695159-1b4c-402e-a54d-75880362b2fa req-9869c277-12a0-4031-821d-5bb28e6c05cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042493 Apr 12 03:33:51 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 83/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b83d7fdc-4d9e-46eb-995b-31c5dc3af7db req-0ad50562-47b1-49b4-9b9c-027c04788ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "name": "network-vif-unplugged", "status": "completed", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b83d7fdc-4d9e-46eb-995b-31c5dc3af7db req-0ad50562-47b1-49b4-9b9c-027c04788ffc service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b83d7fdc-4d9e-46eb-995b-31c5dc3af7db req-0ad50562-47b1-49b4-9b9c-027c04788ffc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b83d7fdc-4d9e-46eb-995b-31c5dc3af7db req-0ad50562-47b1-49b4-9b9c-027c04788ffc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b83d7fdc-4d9e-46eb-995b-31c5dc3af7db req-0ad50562-47b1-49b4-9b9c-027c04788ffc service nova] Creating event network-vif-unplugged:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:33:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b83d7fdc-4d9e-46eb-995b-31c5dc3af7db req-0ad50562-47b1-49b4-9b9c-027c04788ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028585 Apr 12 03:33:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 81/246] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] HTTP exception thrown: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Request method failure captured: Apr 12 03:33:51 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba HTTP/1.1 Apr 12 03:33:51 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:33:51 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:33:51 user devstack@n-api.service[62074]: Connection: close Apr 12 03:33:51 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:33:51 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:33:51 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:33:51 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:33:51 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW68z0e73GTjPHL0k8AAMrW923p_FG1XzJCi3eTX39p_vdQCjkH9lMUbEL1tC3Dsx3s-uUP0hEznK-Cph3nM_SxCfaB-gLOYpRfKJT9eAw-Rh08_AXFszO03RLJyRsPHOA-p9_3nrEPHYeGw9-hKJTWzWxjUXoS-hZ6EvaA32FHQVQ Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Project-Id: bd808e7e237f4c7490abaff5db0e3529 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Project-Name: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd808e7e237f4c7490abaff5db0e3529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd808e7e237f4c7490abaff5db0e3529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd808e7e237f4c7490abaff5db0e3529"}]}] Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Tenant: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Tenant-Id: bd808e7e237f4c7490abaff5db0e3529 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-User: tempest-TaggedBootDevicesTest-1194851633-project-member Apr 12 03:33:51 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:33:51 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:33:51 user devstack@n-api.service[62074]: X-User-Id: d29b6ed431d64bcab02c2348feab9aa6 Apr 12 03:33:51 user devstack@n-api.service[62074]: X-User-Name: tempest-TaggedBootDevicesTest-1194851633-project-member Apr 12 03:33:51 user devstack@n-api.service[62074]: method: > Apr 12 03:33:51 user devstack@n-api.service[62074]: exception: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62074]: action_args: {'id': '43289ac5-3300-4e1f-8d07-2d66ee78e7ba'} Apr 12 03:33:51 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Returning 404 to user: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2fea5bfd-7678-4343-84f3-ff10913b8b43 tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 404 len: 111 microversion: 2.32 time: 0.041934 Apr 12 03:33:51 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:33:51 2023] DELETE /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] [instance: 43289ac5-3300-4e1f-8d07-2d66ee78e7ba] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] HTTP exception thrown: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Request method failure captured: Apr 12 03:33:51 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba HTTP/1.1 Apr 12 03:33:51 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:33:51 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:33:51 user devstack@n-api.service[62072]: Connection: close Apr 12 03:33:51 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:33:51 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:33:51 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:33:51 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:33:51 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW68z0e73GTjPHL0k8AAMrW923p_FG1XzJCi3eTX39p_vdQCjkH9lMUbEL1tC3Dsx3s-uUP0hEznK-Cph3nM_SxCfaB-gLOYpRfKJT9eAw-Rh08_AXFszO03RLJyRsPHOA-p9_3nrEPHYeGw9-hKJTWzWxjUXoS-hZ6EvaA32FHQVQ Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Project-Id: bd808e7e237f4c7490abaff5db0e3529 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Project-Name: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd808e7e237f4c7490abaff5db0e3529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd808e7e237f4c7490abaff5db0e3529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd808e7e237f4c7490abaff5db0e3529"}]}] Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Tenant: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Tenant-Id: bd808e7e237f4c7490abaff5db0e3529 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1194851633 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-User: tempest-TaggedBootDevicesTest-1194851633-project-member Apr 12 03:33:51 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:33:51 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:33:51 user devstack@n-api.service[62072]: X-User-Id: d29b6ed431d64bcab02c2348feab9aa6 Apr 12 03:33:51 user devstack@n-api.service[62072]: X-User-Name: tempest-TaggedBootDevicesTest-1194851633-project-member Apr 12 03:33:51 user devstack@n-api.service[62072]: method: > Apr 12 03:33:51 user devstack@n-api.service[62072]: exception: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62072]: action_args: {'id': '43289ac5-3300-4e1f-8d07-2d66ee78e7ba'} Apr 12 03:33:51 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. Apr 12 03:33:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] Returning 404 to user: Instance 43289ac5-3300-4e1f-8d07-2d66ee78e7ba could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f69bb884-a5e2-45c1-98e8-f04ed6c39e6f tempest-TaggedBootDevicesTest-1194851633 tempest-TaggedBootDevicesTest-1194851633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba" status: 404 len: 111 microversion: 2.32 time: 0.031928 Apr 12 03:33:51 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 84/248] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:51 2023] GET /compute/v2.1/servers/43289ac5-3300-4e1f-8d07-2d66ee78e7ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:33:53 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-plugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}, {"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-plugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}, {"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-plugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}, {"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-unplugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Creating event network-vif-plugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Creating event network-vif-plugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Creating event network-vif-plugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] Creating event network-vif-unplugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-bd3b2598-2731-4b3b-ad5b-f365ee93cd5e req-62c0d44d-d9fe-44ef-93b3-b4909f256c37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.036564 Apr 12 03:33:53 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-e96565c4-426f-440a-b2d7-45133f49c197 req-c0e5b74d-f6d6-4560-8601-0738865434f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "name": "network-vif-plugged", "status": "completed", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e96565c4-426f-440a-b2d7-45133f49c197 req-c0e5b74d-f6d6-4560-8601-0738865434f8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e96565c4-426f-440a-b2d7-45133f49c197 req-c0e5b74d-f6d6-4560-8601-0738865434f8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e96565c4-426f-440a-b2d7-45133f49c197 req-c0e5b74d-f6d6-4560-8601-0738865434f8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-e96565c4-426f-440a-b2d7-45133f49c197 req-c0e5b74d-f6d6-4560-8601-0738865434f8 service nova] Creating event network-vif-plugged:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:33:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-e96565c4-426f-440a-b2d7-45133f49c197 req-c0e5b74d-f6d6-4560-8601-0738865434f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037078 Apr 12 03:33:53 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] [instance: f1a0f3cf-1004-4ff9-9e41-d03291abbb9a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] HTTP exception thrown: Instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a could not be found. Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Request method failure captured: Apr 12 03:33:53 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a HTTP/1.1 Apr 12 03:33:53 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:33:53 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:33:53 user devstack@n-api.service[62072]: Connection: close Apr 12 03:33:53 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:33:53 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:33:53 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:33:53 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:33:53 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiX-9GNWvslUaeAPgk7EaEMUXjKHvRbFwUlZHG3VG_au1653VyluQ3c9Syb88QKe9R6I4jj5KGYrdJ8c1fxhjP-g7k3n2uHInfQG8tm2IUpn7_zXWzZPnd-idTMITaFTs6Db_ci45e2HzcB9rTtc8cGYThY-UDSj5PUDV7G3NL62pSw Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Project-Id: f71b2bab30884740b8e6d2c268c7635b Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesNegativeTest-833717359 Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f71b2bab30884740b8e6d2c268c7635b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f71b2bab30884740b8e6d2c268c7635b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f71b2bab30884740b8e6d2c268c7635b"}]}] Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesNegativeTest-833717359 Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Tenant-Id: f71b2bab30884740b8e6d2c268c7635b Apr 12 03:33:53 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesNegativeTest-833717359 Apr 12 03:33:53 user devstack@n-api.service[62072]: X-User: tempest-VolumesNegativeTest-833717359-project-member Apr 12 03:33:53 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:33:53 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:33:53 user devstack@n-api.service[62072]: X-User-Id: 1183761babfc4ba3b6f6febe28254c15 Apr 12 03:33:53 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesNegativeTest-833717359-project-member Apr 12 03:33:53 user devstack@n-api.service[62072]: method: > Apr 12 03:33:53 user devstack@n-api.service[62072]: exception: Instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a could not be found. Apr 12 03:33:53 user devstack@n-api.service[62072]: action_args: {'id': 'f1a0f3cf-1004-4ff9-9e41-d03291abbb9a'} Apr 12 03:33:53 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a could not be found. Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a could not be found. Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a could not be found. Apr 12 03:33:53 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:33:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] Returning 404 to user: Instance f1a0f3cf-1004-4ff9-9e41-d03291abbb9a could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:33:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c8197f6f-2b59-4fa6-a90b-791e42f1480e tempest-VolumesNegativeTest-833717359 tempest-VolumesNegativeTest-833717359-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a" status: 404 len: 111 microversion: 2.1 time: 0.094699 Apr 12 03:33:53 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 85/251] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:53 2023] GET /compute/v2.1/servers/f1a0f3cf-1004-4ff9-9e41-d03291abbb9a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9bb37532-9df1-4ab7-8233-3f792222e513 req-21747029-a07f-4be0-8ee3-7fe1d4b24ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-plugged", "status": "completed", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9bb37532-9df1-4ab7-8233-3f792222e513 req-21747029-a07f-4be0-8ee3-7fe1d4b24ad2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9bb37532-9df1-4ab7-8233-3f792222e513 req-21747029-a07f-4be0-8ee3-7fe1d4b24ad2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9bb37532-9df1-4ab7-8233-3f792222e513 req-21747029-a07f-4be0-8ee3-7fe1d4b24ad2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728398d-524b-4f22-b91b-a431d62a952c", "name": "network-vif-deleted", "tag": "b0727a17-1b28-4bd2-a4bd-ba6f779fb19b"}, {"server_uuid": "ccf9f424-d230-4079-87c5-bb08bc85b0b7", "name": "network-vif-deleted", "tag": "b58865c9-a096-40af-91cf-828e5131ea22"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9bb37532-9df1-4ab7-8233-3f792222e513 req-21747029-a07f-4be0-8ee3-7fe1d4b24ad2 service nova] Creating event network-vif-plugged:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9bb37532-9df1-4ab7-8233-3f792222e513 req-21747029-a07f-4be0-8ee3-7fe1d4b24ad2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 Apr 12 03:33:55 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 83/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] Creating event network-vif-deleted:b0727a17-1b28-4bd2-a4bd-ba6f779fb19b for instance f728398d-524b-4f22-b91b-a431d62a952c on user Apr 12 03:33:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] Creating event network-vif-deleted:b58865c9-a096-40af-91cf-828e5131ea22 for instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 on user Apr 12 03:33:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-535c5fb8-a869-4cdd-873d-22d16fe023b7 req-3f22d0bf-3555-4141-bdce-5e349c8baa0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035846 Apr 12 03:33:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b7fdb9-05e3-4870-b435-4c063881640f"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:55 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:33:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-08ff9f07-5f7d-42f0-8c19-dc17f5fc58d6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391967 Apr 12 03:33:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 86/254] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 03:33:55 2023] POST /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments => generated 188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:55 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62073) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 03:33:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4434d048-8f03-4369-af7e-659bfde9cd73 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/action" status: 202 len: 0 microversion: 2.20 time: 0.137751 Apr 12 03:33:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 84/255] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:33:55 2023] POST /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:56 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a2473e8c-0d0e-4ba7-830f-146c94d20795 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1738 microversion: 2.20 time: 0.224800 Apr 12 03:33:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:56 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:33:59 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-419158f2-6439-40c8-8698-695617e1a97a tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1670 microversion: 2.1 time: 0.299920 Apr 12 03:33:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 87/257] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:33:59 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1670 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:59 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:33:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-407225f9-9421-40ef-b491-9d66628474d9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1768 microversion: 2.87 time: 0.386293 Apr 12 03:33:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 85/258] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:33:59 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1768 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] HTTP exception thrown: Instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 could not be found. Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Request method failure captured: Apr 12 03:34:00 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 HTTP/1.1 Apr 12 03:34:00 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:34:00 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:34:00 user devstack@n-api.service[62074]: Connection: close Apr 12 03:34:00 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:34:00 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:34:00 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:34:00 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:34:00 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiXrKtpOi6wfXYyDm3Wp61jM-OU6tYkmAw65cV_RcAjiHjhIfW82TDOpkoMRNAh2X8eIY0T3DCSN9gaGBdmHqk8AVff_jY41sOYWciRlwHOw1ST1QEfri0fu-E1IAjvCdC-411wOxR3UhRHxj6hVYBsA4fLYFgCxJUQtfGwUpy2aB-M Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Project-Id: 86f7b42b161f41efb234f0ce70210a08 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513599190 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f7b42b161f41efb234f0ce70210a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f7b42b161f41efb234f0ce70210a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f7b42b161f41efb234f0ce70210a08"}]}] Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513599190 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Tenant-Id: 86f7b42b161f41efb234f0ce70210a08 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513599190 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-User: tempest-VolumesSnapshotTestJSON-1513599190-project-member Apr 12 03:34:00 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:34:00 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:34:00 user devstack@n-api.service[62074]: X-User-Id: 84ea3a8776a944178ba5a04bce4d9b05 Apr 12 03:34:00 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513599190-project-member Apr 12 03:34:00 user devstack@n-api.service[62074]: method: > Apr 12 03:34:00 user devstack@n-api.service[62074]: exception: Instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 could not be found. Apr 12 03:34:00 user devstack@n-api.service[62074]: action_args: {'id': 'cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0'} Apr 12 03:34:00 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 could not be found. Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 could not be found. Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 could not be found. Apr 12 03:34:00 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Returning 404 to user: Instance cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-aadde7e9-986d-4fc1-bc32-0e54ec9032b6 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0" status: 404 len: 111 microversion: 2.1 time: 0.038079 Apr 12 03:34:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:00 2023] GET /compute/v2.1/servers/cd5ddb7d-1d62-43a5-a6be-452cd5b1d1b0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2e08409-6c4e-44ef-842b-29460b0cb939"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-02260126-ac47-4eb4-9708-14540898f637 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363756 Apr 12 03:34:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 88/260] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:34:00 2023] POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-73002304-66c3-4133-996b-8648fdf93a7b tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Action: 'create', calling method: .version_select at 0x7f76a6b1f0a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-303163528", "metadata": {"Type": "work"}}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-73002304-66c3-4133-996b-8648fdf93a7b tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Request method failure captured: Apr 12 03:34:02 user devstack@n-api.service[62073]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 03:34:02 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:34:02 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:34:02 user devstack@n-api.service[62073]: Connection: close Apr 12 03:34:02 user devstack@n-api.service[62073]: Content-Length: 121 Apr 12 03:34:02 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:34:02 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:34:02 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:34:02 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiaq91M0se0U3z7CE1qAe-tE3LgPCMjKguioA0vVeppKxCTGhVZoqkH474W91tqG_PI1a0SnWUQk9SCpSMnvRN0mrnpce0sDU-3txQNR4iy0DbyWCPJGfnDaYYHd8A867t6WZTZfALUa9ZbCXAaUavKOqIGTYmLC0yttN-jwjGV4_ZE Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee221c31004e410cb4622de3167fe95f"}]}] Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Id: 33e891e36eeb42b9a7cc83c387ba888f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62073]: Apr 12 03:34:02 user devstack@n-api.service[62073]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-303163528", "metadata": {"Type": "work"}}} Apr 12 03:34:02 user devstack@n-api.service[62073]: method: Apr 12 03:34:02 user devstack@n-api.service[62073]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62073]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-303163528', 'metadata': {'Type': 'work'}}}} Apr 12 03:34:02 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise error Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-73002304-66c3-4133-996b-8648fdf93a7b tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-73002304-66c3-4133-996b-8648fdf93a7b tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.248066 Apr 12 03:34:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 86/261] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 03:34:02 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-04b62f1f-390b-47f4-9769-79e7f2a69f98 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Action: 'create', calling method: .version_select at 0x7f76a6c1be20>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1349776764", "metadata": {"Type": "work"}}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-04b62f1f-390b-47f4-9769-79e7f2a69f98 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Request method failure captured: Apr 12 03:34:02 user devstack@n-api.service[62074]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 03:34:02 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:34:02 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:34:02 user devstack@n-api.service[62074]: Connection: close Apr 12 03:34:02 user devstack@n-api.service[62074]: Content-Length: 120 Apr 12 03:34:02 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:34:02 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:34:02 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:34:02 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiaq91M0se0U3z7CE1qAe-tE3LgPCMjKguioA0vVeppKxCTGhVZoqkH474W91tqG_PI1a0SnWUQk9SCpSMnvRN0mrnpce0sDU-3txQNR4iy0DbyWCPJGfnDaYYHd8A867t6WZTZfALUa9ZbCXAaUavKOqIGTYmLC0yttN-jwjGV4_ZE Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee221c31004e410cb4622de3167fe95f"}]}] Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Tenant-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Id: 33e891e36eeb42b9a7cc83c387ba888f Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62074]: Apr 12 03:34:02 user devstack@n-api.service[62074]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1349776764", "metadata": {"Type": "work"}}} Apr 12 03:34:02 user devstack@n-api.service[62074]: method: Apr 12 03:34:02 user devstack@n-api.service[62074]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 03:34:02 user devstack@n-api.service[62074]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349776764', 'metadata': {'Type': 'work'}}}} Apr 12 03:34:02 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise error Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi '0' Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-04b62f1f-390b-47f4-9769-79e7f2a69f98 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-04b62f1f-390b-47f4-9769-79e7f2a69f98 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013034 Apr 12 03:34:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 88/262] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 03:34:02 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-32fd8e56-9599-4b14-b80b-cf38937ae271 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Action: 'create', calling method: .version_select at 0x7f76a6b8d870>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1780743353", "metadata": {"Type": "work"}}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-32fd8e56-9599-4b14-b80b-cf38937ae271 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Request method failure captured: Apr 12 03:34:02 user devstack@n-api.service[62072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 03:34:02 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:34:02 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:34:02 user devstack@n-api.service[62072]: Connection: close Apr 12 03:34:02 user devstack@n-api.service[62072]: Content-Length: 119 Apr 12 03:34:02 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:34:02 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:34:02 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:34:02 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiaq91M0se0U3z7CE1qAe-tE3LgPCMjKguioA0vVeppKxCTGhVZoqkH474W91tqG_PI1a0SnWUQk9SCpSMnvRN0mrnpce0sDU-3txQNR4iy0DbyWCPJGfnDaYYHd8A867t6WZTZfALUa9ZbCXAaUavKOqIGTYmLC0yttN-jwjGV4_ZE Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Project-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee221c31004e410cb4622de3167fe95f"}]}] Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Tenant-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62072]: X-User: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62072]: X-User-Id: 33e891e36eeb42b9a7cc83c387ba888f Apr 12 03:34:02 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62072]: Apr 12 03:34:02 user devstack@n-api.service[62072]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1780743353", "metadata": {"Type": "work"}}} Apr 12 03:34:02 user devstack@n-api.service[62072]: method: Apr 12 03:34:02 user devstack@n-api.service[62072]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62072]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1780743353', 'metadata': {'Type': 'work'}}}} Apr 12 03:34:02 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise error Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi '' Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 03:34:02 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-32fd8e56-9599-4b14-b80b-cf38937ae271 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-32fd8e56-9599-4b14-b80b-cf38937ae271 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024558 Apr 12 03:34:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 89/263] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 03:34:02 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5dedc9ac-e956-41ab-b238-982242f6f1d0 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Calling method '.version_select at 0x7f76a6b7b640>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-5dedc9ac-e956-41ab-b238-982242f6f1d0 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] HTTP exception thrown: Volume tempest-invalid-1708941165 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5dedc9ac-e956-41ab-b238-982242f6f1d0 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Request method failure captured: Apr 12 03:34:02 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1708941165 HTTP/1.1 Apr 12 03:34:02 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:34:02 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:34:02 user devstack@n-api.service[62073]: Connection: close Apr 12 03:34:02 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:34:02 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:34:02 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:34:02 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:34:02 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiaq91M0se0U3z7CE1qAe-tE3LgPCMjKguioA0vVeppKxCTGhVZoqkH474W91tqG_PI1a0SnWUQk9SCpSMnvRN0mrnpce0sDU-3txQNR4iy0DbyWCPJGfnDaYYHd8A867t6WZTZfALUa9ZbCXAaUavKOqIGTYmLC0yttN-jwjGV4_ZE Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee221c31004e410cb4622de3167fe95f"}]}] Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Id: 33e891e36eeb42b9a7cc83c387ba888f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62073]: method: Apr 12 03:34:02 user devstack@n-api.service[62073]: exception: Volume tempest-invalid-1708941165 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: action_args: {'id': 'tempest-invalid-1708941165'} Apr 12 03:34:02 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1708941165 could not be found. (HTTP 404) (Request-ID: req-05340d87-3db8-498b-b778-3f5c357d80c4) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1708941165 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1708941165 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1708941165 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5dedc9ac-e956-41ab-b238-982242f6f1d0 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Returning 404 to user: Volume tempest-invalid-1708941165 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-5dedc9ac-e956-41ab-b238-982242f6f1d0 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1708941165" status: 404 len: 99 microversion: 2.1 time: 0.047076 Apr 12 03:34:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 87/264] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:34:02 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1708941165 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4c7a3c1b-fa0b-407f-8820-6f8efb9d9746 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006962 Apr 12 03:34:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 03:34:02 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-8651b95a-49a6-4e40-96e5-f6520d84eb3b tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003917 Apr 12 03:34:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 90/266] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 03:34:02 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-07e26661-a393-4701-83bb-e8f6cd995405 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Calling method '.version_select at 0x7f76a6b7b6d0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-07e26661-a393-4701-83bb-e8f6cd995405 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] HTTP exception thrown: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-07e26661-a393-4701-83bb-e8f6cd995405 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Request method failure captured: Apr 12 03:34:02 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/os-volumes/de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 HTTP/1.1 Apr 12 03:34:02 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:34:02 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:34:02 user devstack@n-api.service[62073]: Connection: close Apr 12 03:34:02 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:34:02 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:34:02 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:34:02 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:34:02 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiaq91M0se0U3z7CE1qAe-tE3LgPCMjKguioA0vVeppKxCTGhVZoqkH474W91tqG_PI1a0SnWUQk9SCpSMnvRN0mrnpce0sDU-3txQNR4iy0DbyWCPJGfnDaYYHd8A867t6WZTZfALUa9ZbCXAaUavKOqIGTYmLC0yttN-jwjGV4_ZE Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee221c31004e410cb4622de3167fe95f"}]}] Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Id: 33e891e36eeb42b9a7cc83c387ba888f Apr 12 03:34:02 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62073]: method: Apr 12 03:34:02 user devstack@n-api.service[62073]: exception: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: action_args: {'id': 'de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0'} Apr 12 03:34:02 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. (HTTP 404) (Request-ID: req-bdf2f824-5d7c-464e-a776-40e8f01707fa) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. Apr 12 03:34:02 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-07e26661-a393-4701-83bb-e8f6cd995405 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Returning 404 to user: Volume de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-07e26661-a393-4701-83bb-e8f6cd995405 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0" status: 404 len: 109 microversion: 2.1 time: 0.041550 Apr 12 03:34:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 88/267] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:34:02 2023] DELETE /compute/v2.1/os-volumes/de6b3a3b-b58e-45d5-8f50-0e4ebd341ff0 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-82266152-562c-4e2f-92bc-34b1dfd0a8c6 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Calling method '.version_select at 0x7f76a6c18b80>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-82266152-562c-4e2f-92bc-34b1dfd0a8c6 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] HTTP exception thrown: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. Apr 12 03:34:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-82266152-562c-4e2f-92bc-34b1dfd0a8c6 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Request method failure captured: Apr 12 03:34:02 user devstack@n-api.service[62074]: request: GET /compute/v2.1/os-volumes/762797cf-31d9-4fe9-a819-55ddd58ee5dc HTTP/1.1 Apr 12 03:34:02 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:34:02 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:34:02 user devstack@n-api.service[62074]: Connection: close Apr 12 03:34:02 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:34:02 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:34:02 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:34:02 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:34:02 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiaq91M0se0U3z7CE1qAe-tE3LgPCMjKguioA0vVeppKxCTGhVZoqkH474W91tqG_PI1a0SnWUQk9SCpSMnvRN0mrnpce0sDU-3txQNR4iy0DbyWCPJGfnDaYYHd8A867t6WZTZfALUa9ZbCXAaUavKOqIGTYmLC0yttN-jwjGV4_ZE Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee221c31004e410cb4622de3167fe95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee221c31004e410cb4622de3167fe95f"}]}] Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Tenant-Id: ee221c31004e410cb4622de3167fe95f Apr 12 03:34:02 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesNegativeTest-275779989 Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Id: 33e891e36eeb42b9a7cc83c387ba888f Apr 12 03:34:02 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesNegativeTest-275779989-project-member Apr 12 03:34:02 user devstack@n-api.service[62074]: method: Apr 12 03:34:02 user devstack@n-api.service[62074]: exception: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. Apr 12 03:34:02 user devstack@n-api.service[62074]: action_args: {'id': '762797cf-31d9-4fe9-a819-55ddd58ee5dc'} Apr 12 03:34:02 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. (HTTP 404) (Request-ID: req-05ba67f5-3100-42fe-87a4-8c27fa62fddb) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. Apr 12 03:34:02 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-82266152-562c-4e2f-92bc-34b1dfd0a8c6 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] Returning 404 to user: Volume 762797cf-31d9-4fe9-a819-55ddd58ee5dc could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-82266152-562c-4e2f-92bc-34b1dfd0a8c6 tempest-VolumesNegativeTest-275779989 tempest-VolumesNegativeTest-275779989-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/762797cf-31d9-4fe9-a819-55ddd58ee5dc" status: 404 len: 109 microversion: 2.1 time: 0.067300 Apr 12 03:34:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 90/268] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:34:02 2023] GET /compute/v2.1/os-volumes/762797cf-31d9-4fe9-a819-55ddd58ee5dc => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:34:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-289f9787-3fda-4e2e-92b6-6d015071b3d4 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Action: 'create', calling method: .version_select at 0x7f76a79de4d0>, body: {"keypair": {"name": "tempest-keypair-52848813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqZ2JOd0oMveikCRo3egpYXw6F7M9CSnvg8uuSzQFHFmYKOQ1+3ysT+GbPl8KtibugwjCH/8obQl0aNd57dyywpuoimEfD8++mntdrmImk7chBwlJ4Kqnvt9BRQOwzT8Q=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:02 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-289f9787-3fda-4e2e-92b6-6d015071b3d4 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Getting quotas for project a327d22640aa4a7caeb35fb0ed2dccc8. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:34:02 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-289f9787-3fda-4e2e-92b6-6d015071b3d4 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Getting quotas for user 3a7c2b6c06a745de95fae59f8b02c06d and project a327d22640aa4a7caeb35fb0ed2dccc8. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:34:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-289f9787-3fda-4e2e-92b6-6d015071b3d4 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.49 time: 0.074978 Apr 12 03:34:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 91/269] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 03:34:02 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 03:34:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-277a4a62-79fa-4c4b-9f64-5e10a452df6b req-2ca2d666-126a-40ff-a8d8-20e3451ad801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-277a4a62-79fa-4c4b-9f64-5e10a452df6b req-2ca2d666-126a-40ff-a8d8-20e3451ad801 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-277a4a62-79fa-4c4b-9f64-5e10a452df6b req-2ca2d666-126a-40ff-a8d8-20e3451ad801 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-277a4a62-79fa-4c4b-9f64-5e10a452df6b req-2ca2d666-126a-40ff-a8d8-20e3451ad801 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-277a4a62-79fa-4c4b-9f64-5e10a452df6b req-2ca2d666-126a-40ff-a8d8-20e3451ad801 service nova] Creating event network-changed:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:34:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-277a4a62-79fa-4c4b-9f64-5e10a452df6b req-2ca2d666-126a-40ff-a8d8-20e3451ad801 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031443 Apr 12 03:34:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 89/270] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-934756275", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "8d284b3a-85a8-45a3-845f-271f3fe80540"}], "security_groups": [{"name": "tempest-securitygroup--1903819298"}], "key_name": "tempest-keypair-52848813", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:05 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] validate_networks() for [('8d284b3a-85a8-45a3-845f-271f3fe80540', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Getting quotas for project a327d22640aa4a7caeb35fb0ed2dccc8. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Getting quotas for user 3a7c2b6c06a745de95fae59f8b02c06d and project a327d22640aa4a7caeb35fb0ed2dccc8. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:34:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:34:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d786b7e7-1208-4ea7-bc41-3277b8e45960 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.633013 Apr 12 03:34:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 91/271] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:34:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:34:06 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a539a200-5673-4b0f-8a19-6b79816ed1e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a539a200-5673-4b0f-8a19-6b79816ed1e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:06 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-a539a200-5673-4b0f-8a19-6b79816ed1e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:06 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-a539a200-5673-4b0f-8a19-6b79816ed1e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:06 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-a539a200-5673-4b0f-8a19-6b79816ed1e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:06 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a539a200-5673-4b0f-8a19-6b79816ed1e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 200 len: 1318 microversion: 2.49 time: 0.165000 Apr 12 03:34:06 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 92/272] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:34:06 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:09 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ce23d3cf-4f48-4ea6-a924-0f3d57979c7b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1540 microversion: 2.1 time: 0.373492 Apr 12 03:34:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 90/273] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:08 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1540 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "3edad615-4b98-4e15-bf3e-72fa0b622eca"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-cdc974d8-4f2d-4477-9afc-ea8452cb7475 req-c7723c8c-b486-434e-a3df-57c1b637a38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:10 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lazy-loading 'flavor' on Instance uuid 72ba1218-065d-40c4-8503-7c4155e47503 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cdc974d8-4f2d-4477-9afc-ea8452cb7475 req-c7723c8c-b486-434e-a3df-57c1b637a38e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cdc974d8-4f2d-4477-9afc-ea8452cb7475 req-c7723c8c-b486-434e-a3df-57c1b637a38e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cdc974d8-4f2d-4477-9afc-ea8452cb7475 req-c7723c8c-b486-434e-a3df-57c1b637a38e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cdc974d8-4f2d-4477-9afc-ea8452cb7475 req-c7723c8c-b486-434e-a3df-57c1b637a38e service nova] Creating event network-changed:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:34:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-cdc974d8-4f2d-4477-9afc-ea8452cb7475 req-c7723c8c-b486-434e-a3df-57c1b637a38e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038579 Apr 12 03:34:10 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 93/274] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:10 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-99867029", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "07d0f97b-06f9-40b3-8794-e53924379d25"}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:10 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4014d9d6-b6e2-45bc-bb8c-d07dece28fb9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/action" status: 200 len: 29 microversion: 2.1 time: 0.559635 Apr 12 03:34:10 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 92/275] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:34:10 2023] POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/action => generated 29 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:34:10 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] validate_networks() for [('07d0f97b-06f9-40b3-8794-e53924379d25', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:11 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ada452f2-af26-475c-8f9d-8406f4a8db20 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1722 microversion: 2.1 time: 0.367141 Apr 12 03:34:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 94/276] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:10 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Getting quotas for project 86f7b42b161f41efb234f0ce70210a08. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Getting quotas for user 84ea3a8776a944178ba5a04bce4d9b05 and project 86f7b42b161f41efb234f0ce70210a08. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:34:12 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:34:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bba1a3f9-6667-4ec1-88e2-d95fecfb4c8d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.605592 Apr 12 03:34:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 91/277] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:34:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:34:12 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c2c8c16c-665a-45b3-9916-7d6fc383351e tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:12 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c2c8c16c-665a-45b3-9916-7d6fc383351e tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:12 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-c2c8c16c-665a-45b3-9916-7d6fc383351e tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84ea3a8776a944178ba5a04bce4d9b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f7b42b161f41efb234f0ce70210a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c2c8c16c-665a-45b3-9916-7d6fc383351e tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f" status: 200 len: 1211 microversion: 2.1 time: 0.118654 Apr 12 03:34:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 93/278] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:12 2023] GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:34:12 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-77b3cd56-21a9-4892-9529-43833d94fb58 req-1eb31a29-a312-4469-abc1-ff2854739957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-unplugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-77b3cd56-21a9-4892-9529-43833d94fb58 req-1eb31a29-a312-4469-abc1-ff2854739957 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-77b3cd56-21a9-4892-9529-43833d94fb58 req-1eb31a29-a312-4469-abc1-ff2854739957 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-77b3cd56-21a9-4892-9529-43833d94fb58 req-1eb31a29-a312-4469-abc1-ff2854739957 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-77b3cd56-21a9-4892-9529-43833d94fb58 req-1eb31a29-a312-4469-abc1-ff2854739957 service nova] Creating event network-vif-unplugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:34:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-77b3cd56-21a9-4892-9529-43833d94fb58 req-1eb31a29-a312-4469-abc1-ff2854739957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051067 Apr 12 03:34:12 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 95/279] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:14 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f3da2e56-79f7-4563-b244-8fea1d8b5a3d req-b52b4be4-658b-4729-943a-ff1b237f656c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f3da2e56-79f7-4563-b244-8fea1d8b5a3d req-b52b4be4-658b-4729-943a-ff1b237f656c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f3da2e56-79f7-4563-b244-8fea1d8b5a3d req-b52b4be4-658b-4729-943a-ff1b237f656c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f3da2e56-79f7-4563-b244-8fea1d8b5a3d req-b52b4be4-658b-4729-943a-ff1b237f656c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f3da2e56-79f7-4563-b244-8fea1d8b5a3d req-b52b4be4-658b-4729-943a-ff1b237f656c service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:34:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f3da2e56-79f7-4563-b244-8fea1d8b5a3d req-b52b4be4-658b-4729-943a-ff1b237f656c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198210 Apr 12 03:34:15 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 92/280] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-56d6f026-61c9-44f2-8428-88d32ab40706 req-b707047a-efe1-4da4-9e75-68c3ee9f95d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-plugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-56d6f026-61c9-44f2-8428-88d32ab40706 req-b707047a-efe1-4da4-9e75-68c3ee9f95d6 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-56d6f026-61c9-44f2-8428-88d32ab40706 req-b707047a-efe1-4da4-9e75-68c3ee9f95d6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-56d6f026-61c9-44f2-8428-88d32ab40706 req-b707047a-efe1-4da4-9e75-68c3ee9f95d6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-56d6f026-61c9-44f2-8428-88d32ab40706 req-b707047a-efe1-4da4-9e75-68c3ee9f95d6 service nova] Creating event network-vif-plugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:34:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-56d6f026-61c9-44f2-8428-88d32ab40706 req-b707047a-efe1-4da4-9e75-68c3ee9f95d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042595 Apr 12 03:34:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 94/281] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:17 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-plugged", "status": "completed", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}, {"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-plugged", "status": "completed", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:17 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:17 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] Creating event network-vif-plugged:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:34:17 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] Creating event network-vif-plugged:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:34:17 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-12b13804-d5c6-4534-b609-62afae036a34 req-c1184c9e-576d-4529-93a6-8df4b2d9a08a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080358 Apr 12 03:34:17 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 96/282] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:17 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7dc7d582-a1e7-449d-ad15-8e6c58937051 req-526b627b-742d-4321-85f6-0ac95b877132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-plugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7dc7d582-a1e7-449d-ad15-8e6c58937051 req-526b627b-742d-4321-85f6-0ac95b877132 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7dc7d582-a1e7-449d-ad15-8e6c58937051 req-526b627b-742d-4321-85f6-0ac95b877132 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7dc7d582-a1e7-449d-ad15-8e6c58937051 req-526b627b-742d-4321-85f6-0ac95b877132 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7dc7d582-a1e7-449d-ad15-8e6c58937051 req-526b627b-742d-4321-85f6-0ac95b877132 service nova] Creating event network-vif-plugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:34:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7dc7d582-a1e7-449d-ad15-8e6c58937051 req-526b627b-742d-4321-85f6-0ac95b877132 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040758 Apr 12 03:34:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 93/283] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f", "tag": "e3161de1-7643-4b1a-8a0c-27791fed8dbd"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:19 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:19 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Creating event network-changed:e3161de1-7643-4b1a-8a0c-27791fed8dbd for instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f on user Apr 12 03:34:19 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:34:19 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:34:19 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-cacc92e0-b70f-46cc-926e-5103ff3839e2 req-5e3b5e65-b341-49ac-b6e9-d0e0ef59ea24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.072131 Apr 12 03:34:19 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 95/284] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:19 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-4c3ac44e-e0c3-4b48-b24e-b07ca6d748f6 req-d537b203-63a1-4709-9f45-5b2e03ad453c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f", "name": "network-vif-plugged", "status": "completed", "tag": "e3161de1-7643-4b1a-8a0c-27791fed8dbd"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:20 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4c3ac44e-e0c3-4b48-b24e-b07ca6d748f6 req-d537b203-63a1-4709-9f45-5b2e03ad453c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4c3ac44e-e0c3-4b48-b24e-b07ca6d748f6 req-d537b203-63a1-4709-9f45-5b2e03ad453c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4c3ac44e-e0c3-4b48-b24e-b07ca6d748f6 req-d537b203-63a1-4709-9f45-5b2e03ad453c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4c3ac44e-e0c3-4b48-b24e-b07ca6d748f6 req-d537b203-63a1-4709-9f45-5b2e03ad453c service nova] Creating event network-vif-plugged:e3161de1-7643-4b1a-8a0c-27791fed8dbd for instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f on user Apr 12 03:34:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-4c3ac44e-e0c3-4b48-b24e-b07ca6d748f6 req-d537b203-63a1-4709-9f45-5b2e03ad453c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043896 Apr 12 03:34:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 97/285] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f8db0848-12fe-44d8-b4d5-79a1489f38bb req-946804b0-aece-481e-8ee1-331f8591dd7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f", "name": "network-vif-plugged", "status": "completed", "tag": "e3161de1-7643-4b1a-8a0c-27791fed8dbd"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f8db0848-12fe-44d8-b4d5-79a1489f38bb req-946804b0-aece-481e-8ee1-331f8591dd7a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f8db0848-12fe-44d8-b4d5-79a1489f38bb req-946804b0-aece-481e-8ee1-331f8591dd7a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f8db0848-12fe-44d8-b4d5-79a1489f38bb req-946804b0-aece-481e-8ee1-331f8591dd7a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f8db0848-12fe-44d8-b4d5-79a1489f38bb req-946804b0-aece-481e-8ee1-331f8591dd7a service nova] Creating event network-vif-plugged:e3161de1-7643-4b1a-8a0c-27791fed8dbd for instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f on user Apr 12 03:34:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f8db0848-12fe-44d8-b4d5-79a1489f38bb req-946804b0-aece-481e-8ee1-331f8591dd7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061122 Apr 12 03:34:22 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 94/286] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:29 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:29 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4f603029-c8e7-499d-a9a5-a2d922ac96b6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'create', calling method: .version_select at 0x7f76a6c191b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2058975683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkexWkk4Rxu6k02iex2AsbJ+PDY5htmdDN8vQSba2S3zwrjAPkO8wlI5tbs0OLJWNWhrMe6/AoKb3eoA7zRDJCJlh8REZk8FLy3CbfuwbBsBPrnYnRJ2rfKKtaAGF256w=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:29 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4f603029-c8e7-499d-a9a5-a2d922ac96b6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:34:29 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4f603029-c8e7-499d-a9a5-a2d922ac96b6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for user 3f8024260bf14d9995e67cb0d1bc8ddc and project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:34:29 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4f603029-c8e7-499d-a9a5-a2d922ac96b6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.073425 Apr 12 03:34:29 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 96/287] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:34:29 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2135071440", "imageRef": "5267358d-2283-43f2-a893-8842d5de70da", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2058975683", "networks": [{"uuid": "91a7501a-44a5-4d48-a1f7-e1195ac99607"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] validate_networks() for [('91a7501a-44a5-4d48-a1f7-e1195ac99607', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for user 3f8024260bf14d9995e67cb0d1bc8ddc and project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:34:29 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5267358d-2283-43f2-a893-8842d5de70da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:34:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-8ec4a6ff-c816-4358-9aca-dde9ce1da36a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.806016 Apr 12 03:34:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 98/288] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:34:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:34:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a33ac2c5-28d4-4f17-b39b-f4c0541e62ec tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:30 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a33ac2c5-28d4-4f17-b39b-f4c0541e62ec tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:30 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-a33ac2c5-28d4-4f17-b39b-f4c0541e62ec tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a33ac2c5-28d4-4f17-b39b-f4c0541e62ec tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1253 microversion: 2.1 time: 0.106304 Apr 12 03:34:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 95/289] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:30 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1253 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:34:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ba23212f-e79e-45fe-b670-0beaf33c641a req-f0a0849a-5f8a-4bf2-a771-7c40a1a2188e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ba23212f-e79e-45fe-b670-0beaf33c641a req-f0a0849a-5f8a-4bf2-a771-7c40a1a2188e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ba23212f-e79e-45fe-b670-0beaf33c641a req-f0a0849a-5f8a-4bf2-a771-7c40a1a2188e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ba23212f-e79e-45fe-b670-0beaf33c641a req-f0a0849a-5f8a-4bf2-a771-7c40a1a2188e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ba23212f-e79e-45fe-b670-0beaf33c641a req-f0a0849a-5f8a-4bf2-a771-7c40a1a2188e service nova] Creating event network-changed:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:34:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ba23212f-e79e-45fe-b670-0beaf33c641a req-f0a0849a-5f8a-4bf2-a771-7c40a1a2188e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033153 Apr 12 03:34:33 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 97/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-206739e5-bc7d-4df5-9340-cfe3706ad427 req-fcb1736b-7027-4d95-af7b-f44da024880a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-plugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-206739e5-bc7d-4df5-9340-cfe3706ad427 req-fcb1736b-7027-4d95-af7b-f44da024880a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-206739e5-bc7d-4df5-9340-cfe3706ad427 req-fcb1736b-7027-4d95-af7b-f44da024880a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-206739e5-bc7d-4df5-9340-cfe3706ad427 req-fcb1736b-7027-4d95-af7b-f44da024880a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-206739e5-bc7d-4df5-9340-cfe3706ad427 req-fcb1736b-7027-4d95-af7b-f44da024880a service nova] Creating event network-vif-plugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:34:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-206739e5-bc7d-4df5-9340-cfe3706ad427 req-fcb1736b-7027-4d95-af7b-f44da024880a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067322 Apr 12 03:34:36 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 99/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:38 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f3a39ab6-f287-4c0d-b814-b5364ddb75c1 req-9ba584d7-b588-4e3c-a319-50bc4da4f576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-plugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:34:38 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=7 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f3a39ab6-f287-4c0d-b814-b5364ddb75c1 req-9ba584d7-b588-4e3c-a319-50bc4da4f576 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f3a39ab6-f287-4c0d-b814-b5364ddb75c1 req-9ba584d7-b588-4e3c-a319-50bc4da4f576 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f3a39ab6-f287-4c0d-b814-b5364ddb75c1 req-9ba584d7-b588-4e3c-a319-50bc4da4f576 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f3a39ab6-f287-4c0d-b814-b5364ddb75c1 req-9ba584d7-b588-4e3c-a319-50bc4da4f576 service nova] Creating event network-vif-plugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:34:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f3a39ab6-f287-4c0d-b814-b5364ddb75c1 req-9ba584d7-b588-4e3c-a319-50bc4da4f576 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047954 Apr 12 03:34:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] [instance: ccf9f424-d230-4079-87c5-bb08bc85b0b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] HTTP exception thrown: Instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 could not be found. Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Request method failure captured: Apr 12 03:34:40 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7 HTTP/1.1 Apr 12 03:34:40 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:34:40 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:34:40 user devstack@n-api.service[62072]: Connection: close Apr 12 03:34:40 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:34:40 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:34:40 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:34:40 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:34:40 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW7aWwqXbbCu2M1LUEZXr_oguDryRiHqGT921UQ-F3zqQ4EbN0X8me4bFi0U_hpcELN-jpGgpgWQmWeOLSSX0PIpU-WnhQIQkFZv5TpZf8kc32EvVFEvz74fjk9-uylQzxZknl7C_53k8akKLR49xC83UZRNL8IuPRLng4Ok3qW2XE Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Project-Id: f51faa215a1546fbaa0db25c9773ba6f Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestVolumeSwap-295510619 Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51faa215a1546fbaa0db25c9773ba6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51faa215a1546fbaa0db25c9773ba6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51faa215a1546fbaa0db25c9773ba6f"}]}] Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Tenant: tempest-TestVolumeSwap-295510619 Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Tenant-Id: f51faa215a1546fbaa0db25c9773ba6f Apr 12 03:34:40 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestVolumeSwap-295510619 Apr 12 03:34:40 user devstack@n-api.service[62072]: X-User: tempest-TestVolumeSwap-295510619-project-member Apr 12 03:34:40 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:34:40 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:34:40 user devstack@n-api.service[62072]: X-User-Id: 09fd9f0996bd48628564e6c170c11a17 Apr 12 03:34:40 user devstack@n-api.service[62072]: X-User-Name: tempest-TestVolumeSwap-295510619-project-member Apr 12 03:34:40 user devstack@n-api.service[62072]: method: > Apr 12 03:34:40 user devstack@n-api.service[62072]: exception: Instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 could not be found. Apr 12 03:34:40 user devstack@n-api.service[62072]: action_args: {'id': 'ccf9f424-d230-4079-87c5-bb08bc85b0b7'} Apr 12 03:34:40 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 could not be found. Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 could not be found. Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 could not be found. Apr 12 03:34:40 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Returning 404 to user: Instance ccf9f424-d230-4079-87c5-bb08bc85b0b7 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c4cf7314-6f4c-4c68-a6e6-3d9e8ec79188 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7" status: 404 len: 111 microversion: 2.1 time: 0.037866 Apr 12 03:34:40 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 100/293] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:40 2023] GET /compute/v2.1/servers/ccf9f424-d230-4079-87c5-bb08bc85b0b7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:34:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] HTTP exception thrown: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:34:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Request method failure captured: Apr 12 03:34:40 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c HTTP/1.1 Apr 12 03:34:40 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:34:40 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:34:40 user devstack@n-api.service[62074]: Connection: close Apr 12 03:34:40 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:34:40 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:34:40 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:34:40 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:34:40 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW-rc7civ_odPK9fyl4-33cQIMenMhNmAY7Y18_9Dd_879WZycL_PiYcvkjCm7KQKY4Vdsybvjmv587cHOpOG6kXI1UAYyznsH8NfV_ceBu-avh0fLQQumXWg4ceJHFVIQKPj4EYHfyWsXUKFjosFwb5_sfx_TmNIO7qcwLEG8kTV4 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Project-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83a7ef3f97fd47849973d4e4482fb5f9"}]}] Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Tenant: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Tenant-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-User: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:34:40 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:34:40 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:34:40 user devstack@n-api.service[62074]: X-User-Id: 3da7394c51664a7caacfda6b7dda9066 Apr 12 03:34:40 user devstack@n-api.service[62074]: X-User-Name: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:34:40 user devstack@n-api.service[62074]: method: > Apr 12 03:34:40 user devstack@n-api.service[62074]: exception: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:34:40 user devstack@n-api.service[62074]: action_args: {'id': 'f728398d-524b-4f22-b91b-a431d62a952c'} Apr 12 03:34:40 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:34:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:34:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Returning 404 to user: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:34:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c41d1bac-be01-4315-ba7f-8d60fe0a2e03 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 404 len: 111 microversion: 2.1 time: 0.056949 Apr 12 03:34:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:40 2023] GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:34:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-37313fd5-1372-4f69-9aff-75588d436c04 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] Calling method '.version_select at 0x7f76a6b1e9e0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:40 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-37313fd5-1372-4f69-9aff-75588d436c04 tempest-TestVolumeSwap-295510619 tempest-TestVolumeSwap-295510619-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586254963" status: 202 len: 0 microversion: 2.1 time: 0.033434 Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:41 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 97/295] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:34:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586254963 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:41 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-91d575fd-a436-4e60-9f16-415b70d724a7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1494 microversion: 2.1 time: 0.228498 Apr 12 03:34:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 101/296] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:34:40 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1494 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:46 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ca45b1b0-d96d-4793-83a9-5ba578dda7ec tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1783 microversion: 2.20 time: 0.182900 Apr 12 03:34:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 99/297] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:34:46 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1783 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:56 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:34:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8b056390-3a9c-470a-bd75-950a334bd644 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 200 len: 1624 microversion: 2.49 time: 0.222284 Apr 12 03:34:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 98/298] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:34:56 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 1624 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "26f3e3a3-e498-43b6-bced-72fd4d993267"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=11 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:00 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lazy-loading 'flavor' on Instance uuid bcd267d2-5b2c-4ed2-b634-0210fae94dfd {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:35:00 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9d691e4a-b2ae-4c44-8a3f-aa85fe7baa87 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd/action" status: 200 len: 29 microversion: 2.87 time: 0.549064 Apr 12 03:35:00 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 102/299] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:35:00 2023] POST /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd/action => generated 29 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=11 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:00 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ad0dbcb0-a21f-4122-b4f7-7af10f9eb533 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1774 microversion: 2.87 time: 0.311372 Apr 12 03:35:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 100/300] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:35:00 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1774 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:01 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-36ca5852-50ba-4eb1-bd66-9b966c17fab9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1702 microversion: 2.1 time: 0.379492 Apr 12 03:35:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 99/301] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:01 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1702 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-9f105538-0ce4-4c49-adfb-253c302eea5b req-a667ed34-1c00-4d7c-8f3c-9a0acbcee8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9f105538-0ce4-4c49-adfb-253c302eea5b req-a667ed34-1c00-4d7c-8f3c-9a0acbcee8e5 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9f105538-0ce4-4c49-adfb-253c302eea5b req-a667ed34-1c00-4d7c-8f3c-9a0acbcee8e5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9f105538-0ce4-4c49-adfb-253c302eea5b req-a667ed34-1c00-4d7c-8f3c-9a0acbcee8e5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-9f105538-0ce4-4c49-adfb-253c302eea5b req-a667ed34-1c00-4d7c-8f3c-9a0acbcee8e5 service nova] Creating event network-vif-unplugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:35:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-9f105538-0ce4-4c49-adfb-253c302eea5b req-a667ed34-1c00-4d7c-8f3c-9a0acbcee8e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046021 Apr 12 03:35:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 103/302] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:02 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84ea3a8776a944178ba5a04bce4d9b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f7b42b161f41efb234f0ce70210a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-5cde92c8-ce10-49c9-9f4f-53bc0eb70b7f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f" status: 200 len: 1495 microversion: 2.1 time: 0.310155 Apr 12 03:35:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 101/303] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:02 2023] GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f => generated 1495 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-6bad47d5-1bd8-4201-b143-225ef8a434b3 req-5b7e0f23-5994-4e99-ba37-0d8360eaf18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6bad47d5-1bd8-4201-b143-225ef8a434b3 req-5b7e0f23-5994-4e99-ba37-0d8360eaf18f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6bad47d5-1bd8-4201-b143-225ef8a434b3 req-5b7e0f23-5994-4e99-ba37-0d8360eaf18f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6bad47d5-1bd8-4201-b143-225ef8a434b3 req-5b7e0f23-5994-4e99-ba37-0d8360eaf18f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6bad47d5-1bd8-4201-b143-225ef8a434b3 req-5b7e0f23-5994-4e99-ba37-0d8360eaf18f service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:35:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-6bad47d5-1bd8-4201-b143-225ef8a434b3 req-5b7e0f23-5994-4e99-ba37-0d8360eaf18f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056199 Apr 12 03:35:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 100/304] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1468791143", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "d390d8d2-1444-42f4-8136-2216da391ac2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "397a8299-6fbd-4bac-97a1-c8cc31fa2e0e"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] validate_networks() for [('397a8299-6fbd-4bac-97a1-c8cc31fa2e0e', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:35:05 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d390d8d2-1444-42f4-8136-2216da391ac2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:35:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-5db1bca2-53ef-4cb9-a3c4-b67a05a4327c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.595575 Apr 12 03:35:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 104/305] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:35:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:35:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b9d6407d-7851-4848-a5e5-2c214154d4e6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:05 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b9d6407d-7851-4848-a5e5-2c214154d4e6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:05 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-b9d6407d-7851-4848-a5e5-2c214154d4e6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-b9d6407d-7851-4848-a5e5-2c214154d4e6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 200 len: 1052 microversion: 2.1 time: 0.082465 Apr 12 03:35:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 102/306] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:05 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 1052 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d01dee42-b155-4e4f-bfdf-8595db3f3d52 req-f30f40b0-45a8-41c7-95b7-99a005650a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d01dee42-b155-4e4f-bfdf-8595db3f3d52 req-f30f40b0-45a8-41c7-95b7-99a005650a67 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d01dee42-b155-4e4f-bfdf-8595db3f3d52 req-f30f40b0-45a8-41c7-95b7-99a005650a67 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d01dee42-b155-4e4f-bfdf-8595db3f3d52 req-f30f40b0-45a8-41c7-95b7-99a005650a67 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d01dee42-b155-4e4f-bfdf-8595db3f3d52 req-f30f40b0-45a8-41c7-95b7-99a005650a67 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:35:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d01dee42-b155-4e4f-bfdf-8595db3f3d52 req-f30f40b0-45a8-41c7-95b7-99a005650a67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065419 Apr 12 03:35:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 101/307] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-fdafa7c0-4708-4d4d-9d6a-a632a545071d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.332022 Apr 12 03:35:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 105/308] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:35:09 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-interface => generated 283 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-b80962a6-598d-4d01-b1ca-d945a7cdfd33 req-1e496ed6-7bbb-4c87-9ac5-69276f4525c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b80962a6-598d-4d01-b1ca-d945a7cdfd33 req-1e496ed6-7bbb-4c87-9ac5-69276f4525c9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b80962a6-598d-4d01-b1ca-d945a7cdfd33 req-1e496ed6-7bbb-4c87-9ac5-69276f4525c9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b80962a6-598d-4d01-b1ca-d945a7cdfd33 req-1e496ed6-7bbb-4c87-9ac5-69276f4525c9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-b80962a6-598d-4d01-b1ca-d945a7cdfd33 req-1e496ed6-7bbb-4c87-9ac5-69276f4525c9 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:35:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-b80962a6-598d-4d01-b1ca-d945a7cdfd33 req-1e496ed6-7bbb-4c87-9ac5-69276f4525c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035158 Apr 12 03:35:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-63b8d5ce-cc9d-45ec-92bd-b93725d76860 req-7c842357-0eb5-479c-a5e9-d0c6b6f94d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-63b8d5ce-cc9d-45ec-92bd-b93725d76860 req-7c842357-0eb5-479c-a5e9-d0c6b6f94d5e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-63b8d5ce-cc9d-45ec-92bd-b93725d76860 req-7c842357-0eb5-479c-a5e9-d0c6b6f94d5e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-63b8d5ce-cc9d-45ec-92bd-b93725d76860 req-7c842357-0eb5-479c-a5e9-d0c6b6f94d5e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-63b8d5ce-cc9d-45ec-92bd-b93725d76860 req-7c842357-0eb5-479c-a5e9-d0c6b6f94d5e service nova] Creating event network-changed:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:35:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-63b8d5ce-cc9d-45ec-92bd-b93725d76860 req-7c842357-0eb5-479c-a5e9-d0c6b6f94d5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035531 Apr 12 03:35:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 102/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-05dc344e-7b51-4239-b3c6-f0a1331e17e1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1540 microversion: 2.1 time: 0.162070 Apr 12 03:35:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 106/311] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:11 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1540 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:11 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-52d1c008-aa23-4542-9e3c-711af217c73c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1540 microversion: 2.1 time: 0.285943 Apr 12 03:35:11 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 104/312] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:11 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1540 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-46c90f7e-d438-440a-9b23-38127fb15b25 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Action: 'create', calling method: .version_select at 0x7f76a6b7b010>, body: {"keypair": {"name": "tempest-keypair-315148094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZmg9av5nHzz+WM/CeO9E4jVqkDumG/6+9A6cHxDvsmxb0GgBIDFr9i3AR8FMpBKXAtQyO3hr0qIi3g2HX/TjWxD4YibE1LO5tXDCbvlMnQhnENYSPZrfx3AZVOxrgL2g=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-46c90f7e-d438-440a-9b23-38127fb15b25 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Getting quotas for project f4cce206e2b94b03ade2d310373c5ca2. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:35:11 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-46c90f7e-d438-440a-9b23-38127fb15b25 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Getting quotas for user e2f496e5fe694d46a9803f797743a7dc and project f4cce206e2b94b03ade2d310373c5ca2. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:35:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-46c90f7e-d438-440a-9b23-38127fb15b25 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149172 Apr 12 03:35:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 103/313] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:35:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-2016f0ba-eb45-40ac-8892-440b5689cf10 req-12153491-ef46-401a-aa8c-fde4aa88b7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2016f0ba-eb45-40ac-8892-440b5689cf10 req-12153491-ef46-401a-aa8c-fde4aa88b7d2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2016f0ba-eb45-40ac-8892-440b5689cf10 req-12153491-ef46-401a-aa8c-fde4aa88b7d2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2016f0ba-eb45-40ac-8892-440b5689cf10 req-12153491-ef46-401a-aa8c-fde4aa88b7d2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2016f0ba-eb45-40ac-8892-440b5689cf10 req-12153491-ef46-401a-aa8c-fde4aa88b7d2 service nova] Creating event network-changed:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:35:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-2016f0ba-eb45-40ac-8892-440b5689cf10 req-12153491-ef46-401a-aa8c-fde4aa88b7d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Apr 12 03:35:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 107/314] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:35:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2065419898", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "263f9508-8639-4289-9210-f9807acf6766"}], "security_groups": [{"name": "tempest-securitygroup--1816826116"}], "key_name": "tempest-keypair-315148094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:13 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] validate_networks() for [('263f9508-8639-4289-9210-f9807acf6766', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Getting quotas for project f4cce206e2b94b03ade2d310373c5ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Getting quotas for user e2f496e5fe694d46a9803f797743a7dc and project f4cce206e2b94b03ade2d310373c5ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:35:14 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:35:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6bdf548d-a951-49c3-95dc-fff4d64fc7f4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.624355 Apr 12 03:35:14 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 105/315] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:35:13 2023] POST /compute/v2.1/servers => generated 404 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:35:14 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-be1f0f79-98e3-46ae-b1bd-eb4d59b366a2 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:14 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-be1f0f79-98e3-46ae-b1bd-eb4d59b366a2 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:14 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-be1f0f79-98e3-46ae-b1bd-eb4d59b366a2 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f496e5fe694d46a9803f797743a7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cce206e2b94b03ade2d310373c5ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:14 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-be1f0f79-98e3-46ae-b1bd-eb4d59b366a2 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6" status: 200 len: 1235 microversion: 2.1 time: 0.203659 Apr 12 03:35:14 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 104/316] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:14 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 => generated 1235 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-539a16d2-79c8-452d-a7b0-ffc73878f740 req-994d363c-a63e-462b-8b54-a3e2cc64ea85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-539a16d2-79c8-452d-a7b0-ffc73878f740 req-994d363c-a63e-462b-8b54-a3e2cc64ea85 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-539a16d2-79c8-452d-a7b0-ffc73878f740 req-994d363c-a63e-462b-8b54-a3e2cc64ea85 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-539a16d2-79c8-452d-a7b0-ffc73878f740 req-994d363c-a63e-462b-8b54-a3e2cc64ea85 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-539a16d2-79c8-452d-a7b0-ffc73878f740 req-994d363c-a63e-462b-8b54-a3e2cc64ea85 service nova] Creating event network-changed:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:35:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-539a16d2-79c8-452d-a7b0-ffc73878f740 req-994d363c-a63e-462b-8b54-a3e2cc64ea85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031554 Apr 12 03:35:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 108/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:19 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ad65848b-cce6-4bc8-9a09-ac4d22892c0a req-08c60e7d-53ee-483f-9112-cdb08a396ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "name": "network-vif-plugged", "status": "completed", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ad65848b-cce6-4bc8-9a09-ac4d22892c0a req-08c60e7d-53ee-483f-9112-cdb08a396ade service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ad65848b-cce6-4bc8-9a09-ac4d22892c0a req-08c60e7d-53ee-483f-9112-cdb08a396ade service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ad65848b-cce6-4bc8-9a09-ac4d22892c0a req-08c60e7d-53ee-483f-9112-cdb08a396ade service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:19 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ad65848b-cce6-4bc8-9a09-ac4d22892c0a req-08c60e7d-53ee-483f-9112-cdb08a396ade service nova] Creating event network-vif-plugged:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:35:19 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ad65848b-cce6-4bc8-9a09-ac4d22892c0a req-08c60e7d-53ee-483f-9112-cdb08a396ade service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138674 Apr 12 03:35:19 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 106/318] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:20 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:20 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-64557e4f-e5ea-46d2-9c27-65b6765fe3af tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1536 microversion: 2.1 time: 0.146801 Apr 12 03:35:20 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 105/319] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:20 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1536 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-8fdb76bb-39e6-4666-8686-c4660d0c67b8 req-b1bb5d54-bcff-4564-9bc0-380bd1cc2b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-plugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8fdb76bb-39e6-4666-8686-c4660d0c67b8 req-b1bb5d54-bcff-4564-9bc0-380bd1cc2b9d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8fdb76bb-39e6-4666-8686-c4660d0c67b8 req-b1bb5d54-bcff-4564-9bc0-380bd1cc2b9d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8fdb76bb-39e6-4666-8686-c4660d0c67b8 req-b1bb5d54-bcff-4564-9bc0-380bd1cc2b9d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-8fdb76bb-39e6-4666-8686-c4660d0c67b8 req-b1bb5d54-bcff-4564-9bc0-380bd1cc2b9d service nova] Creating event network-vif-plugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:35:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-8fdb76bb-39e6-4666-8686-c4660d0c67b8 req-b1bb5d54-bcff-4564-9bc0-380bd1cc2b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133209 Apr 12 03:35:21 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 109/320] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c365588f-72a9-407b-af87-fa05cec03309 req-6cbb7de6-6091-413b-8d4f-7894489a4e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "name": "network-vif-plugged", "status": "completed", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c365588f-72a9-407b-af87-fa05cec03309 req-6cbb7de6-6091-413b-8d4f-7894489a4e2c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c365588f-72a9-407b-af87-fa05cec03309 req-6cbb7de6-6091-413b-8d4f-7894489a4e2c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c365588f-72a9-407b-af87-fa05cec03309 req-6cbb7de6-6091-413b-8d4f-7894489a4e2c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c365588f-72a9-407b-af87-fa05cec03309 req-6cbb7de6-6091-413b-8d4f-7894489a4e2c service nova] Creating event network-vif-plugged:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:35:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c365588f-72a9-407b-af87-fa05cec03309 req-6cbb7de6-6091-413b-8d4f-7894489a4e2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027499 Apr 12 03:35:21 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 107/321] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:23 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-a16755b2-d6ee-42aa-ae00-1de4840003a8 req-cef7a226-92b1-49e2-b1fb-dc7a6cb5d19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-plugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a16755b2-d6ee-42aa-ae00-1de4840003a8 req-cef7a226-92b1-49e2-b1fb-dc7a6cb5d19b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a16755b2-d6ee-42aa-ae00-1de4840003a8 req-cef7a226-92b1-49e2-b1fb-dc7a6cb5d19b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a16755b2-d6ee-42aa-ae00-1de4840003a8 req-cef7a226-92b1-49e2-b1fb-dc7a6cb5d19b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a16755b2-d6ee-42aa-ae00-1de4840003a8 req-cef7a226-92b1-49e2-b1fb-dc7a6cb5d19b service nova] Creating event network-vif-plugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:35:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-a16755b2-d6ee-42aa-ae00-1de4840003a8 req-cef7a226-92b1-49e2-b1fb-dc7a6cb5d19b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Apr 12 03:35:23 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 106/322] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:42 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:42 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c0ddd18d-c7c0-4a7f-8ed8-27131d8f04f7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2113186881", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ee874f05-9bc0-48b1-91aa-f256a12243b1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1a483654-b740-4544-84c9-53a41c11fa88"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-c0ddd18d-c7c0-4a7f-8ed8-27131d8f04f7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] HTTP exception thrown: Block Device ee874f05-9bc0-48b1-91aa-f256a12243b1 is not bootable. Apr 12 03:35:43 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c0ddd18d-c7c0-4a7f-8ed8-27131d8f04f7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Request method failure captured: Apr 12 03:35:43 user devstack@n-api.service[62072]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 03:35:43 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:35:43 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:35:43 user devstack@n-api.service[62072]: Connection: close Apr 12 03:35:43 user devstack@n-api.service[62072]: Content-Length: 357 Apr 12 03:35:43 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:35:43 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:35:43 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:35:43 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW-rc7civ_odPK9fyl4-33cQIMenMhNmAY7Y18_9Dd_879WZycL_PiYcvkjCm7KQKY4Vdsybvjmv587cHOpOG6kXI1UAYyznsH8NfV_ceBu-avh0fLQQumXWg4ceJHFVIQKPj4EYHfyWsXUKFjosFwb5_sfx_TmNIO7qcwLEG8kTV4 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Project-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83a7ef3f97fd47849973d4e4482fb5f9"}]}] Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Tenant: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Tenant-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-User: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:35:43 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:35:43 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:35:43 user devstack@n-api.service[62072]: X-User-Id: 3da7394c51664a7caacfda6b7dda9066 Apr 12 03:35:43 user devstack@n-api.service[62072]: X-User-Name: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:35:43 user devstack@n-api.service[62072]: Apr 12 03:35:43 user devstack@n-api.service[62072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2113186881", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ee874f05-9bc0-48b1-91aa-f256a12243b1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1a483654-b740-4544-84c9-53a41c11fa88"}]}} Apr 12 03:35:43 user devstack@n-api.service[62072]: method: > Apr 12 03:35:43 user devstack@n-api.service[62072]: exception: Block Device ee874f05-9bc0-48b1-91aa-f256a12243b1 is not bootable. Apr 12 03:35:43 user devstack@n-api.service[62072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2113186881', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ee874f05-9bc0-48b1-91aa-f256a12243b1'}], 'networks': [{'uuid': '1a483654-b740-4544-84c9-53a41c11fa88'}]}}} Apr 12 03:35:43 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ee874f05-9bc0-48b1-91aa-f256a12243b1 is not bootable. Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ee874f05-9bc0-48b1-91aa-f256a12243b1 is not bootable. Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ee874f05-9bc0-48b1-91aa-f256a12243b1 is not bootable. Apr 12 03:35:43 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:35:43 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c0ddd18d-c7c0-4a7f-8ed8-27131d8f04f7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Returning 400 to user: Block Device ee874f05-9bc0-48b1-91aa-f256a12243b1 is not bootable. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:35:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c0ddd18d-c7c0-4a7f-8ed8-27131d8f04f7 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.099019 Apr 12 03:35:43 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 110/323] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:35:42 2023] POST /compute/v2.1/servers => generated 110 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=26 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:43 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:43 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-7bd63aef-ab07-4074-a876-f1387e072896 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1494 microversion: 2.1 time: 0.170436 Apr 12 03:35:43 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:43 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1494 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=26 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-47bfe79c-1d60-4fc7-a847-501ff8efd48c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments/e8b7fdb9-05e3-4870-b435-4c063881640f" status: 200 len: 194 microversion: 2.20 time: 0.146684 Apr 12 03:35:46 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 107/325] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 03:35:46 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments/e8b7fdb9-05e3-4870-b435-4c063881640f => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:47 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lazy-loading 'services' on Instance uuid b23d4bcd-989a-45e1-89a3-6e3d30229a32 {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:35:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-caedadc9-b7e9-4b7a-b974-585360cca50d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments/e8b7fdb9-05e3-4870-b435-4c063881640f" status: 202 len: 0 microversion: 2.20 time: 0.173684 Apr 12 03:35:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 111/326] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 03:35:46 2023] DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments/e8b7fdb9-05e3-4870-b435-4c063881640f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-b7807ce5-4938-49ef-91a6-0b5251e0ae2e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044280 Apr 12 03:35:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 109/327] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 03:35:47 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:51 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-db375aac-bd2a-49c4-b145-5c3f9115893f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1754 microversion: 2.87 time: 0.262958 Apr 12 03:35:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 108/328] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:35:51 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1754 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:55 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a71aab4f-5e61-4dc7-b4d5-aa44f4b052ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 200 len: 1379 microversion: 2.1 time: 0.143696 Apr 12 03:35:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 112/329] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:35:55 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 1379 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-082f7765-1a72-4c97-b339-2f48c43641ae tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.086557 Apr 12 03:35:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 110/330] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:35:56 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-interface => generated 282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:35:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-240cc9fa-298c-47f3-9cf7-725932390b12 req-8ba5bf76-37da-4e99-a931-5d1fdd011b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-240cc9fa-298c-47f3-9cf7-725932390b12 req-8ba5bf76-37da-4e99-a931-5d1fdd011b12 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-240cc9fa-298c-47f3-9cf7-725932390b12 req-8ba5bf76-37da-4e99-a931-5d1fdd011b12 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-240cc9fa-298c-47f3-9cf7-725932390b12 req-8ba5bf76-37da-4e99-a931-5d1fdd011b12 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-240cc9fa-298c-47f3-9cf7-725932390b12 req-8ba5bf76-37da-4e99-a931-5d1fdd011b12 service nova] Creating event network-changed:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:35:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-240cc9fa-298c-47f3-9cf7-725932390b12 req-8ba5bf76-37da-4e99-a931-5d1fdd011b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030681 Apr 12 03:35:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 109/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:35:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:57 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:35:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1ccc2f08-2b15-4713-84ed-5d6c340ac449 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 200 len: 1624 microversion: 2.49 time: 0.199194 Apr 12 03:35:57 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 113/332] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:35:57 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 1624 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "a1000896-9015-4517-a0b5-bd056cd9aa89", "tag": "nic-tag"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:35:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:00 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-0498ea5f-5f3a-4e2e-a989-572ed3e7adf3 req-213a071b-2683-4c77-b48a-0a6685d8b175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "tag": "1fcf28a7-3fd9-4283-a0df-be0377b96d42"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0498ea5f-5f3a-4e2e-a989-572ed3e7adf3 req-213a071b-2683-4c77-b48a-0a6685d8b175 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0498ea5f-5f3a-4e2e-a989-572ed3e7adf3 req-213a071b-2683-4c77-b48a-0a6685d8b175 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0498ea5f-5f3a-4e2e-a989-572ed3e7adf3 req-213a071b-2683-4c77-b48a-0a6685d8b175 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-0498ea5f-5f3a-4e2e-a989-572ed3e7adf3 req-213a071b-2683-4c77-b48a-0a6685d8b175 service nova] Creating event network-changed:1fcf28a7-3fd9-4283-a0df-be0377b96d42 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:36:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-0498ea5f-5f3a-4e2e-a989-572ed3e7adf3 req-213a071b-2683-4c77-b48a-0a6685d8b175 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040222 Apr 12 03:36:00 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f6e04353-87b6-4ef2-a095-9bb54e18b617 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-interface" status: 200 len: 280 microversion: 2.49 time: 3.368303 Apr 12 03:36:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 111/334] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 03:35:57 2023] POST /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-interface => generated 280 bytes in 3370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c45cb5c-d38a-4f37-959c-08611a51e9a8", "tag": "volume-tag"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1ec8a6fa-9f33-4cf4-b3bc-86bb15f317e5 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.372362 Apr 12 03:36:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 114/335] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 03:36:01 2023] POST /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b8185c00-e879-43d6-9f0c-9a4e408f707a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1659 microversion: 2.1 time: 0.213206 Apr 12 03:36:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 111/336] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:01 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1659 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c25d0d32-9025-4b76-abf2-a42652d8745b tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/action" status: 202 len: 0 microversion: 2.1 time: 0.225059 Apr 12 03:36:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 112/337] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:36:01 2023] POST /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:02 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-be2afc7f-829d-46f9-bb32-382fed1af311 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1659 microversion: 2.1 time: 0.188142 Apr 12 03:36:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 115/338] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:01 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1659 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-plugged", "status": "completed", "tag": "1fcf28a7-3fd9-4283-a0df-be0377b96d42"}, {"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-plugged", "status": "completed", "tag": "1fcf28a7-3fd9-4283-a0df-be0377b96d42"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] Creating event network-vif-plugged:1fcf28a7-3fd9-4283-a0df-be0377b96d42 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:36:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] Creating event network-vif-plugged:1fcf28a7-3fd9-4283-a0df-be0377b96d42 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:36:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-fd9e0537-1001-4557-941f-d06a2ebceea8 req-5877be66-acb7-432a-b549-3bbc3de97ae2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031605 Apr 12 03:36:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 113/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-29fcaac1-654d-4ac0-af72-454ea28ff1a4 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.180583 Apr 12 03:36:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 112/340] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:36:01 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b48ff4ab-9969-4337-bce5-6dcdfced462a", "device": "/dev/vdb"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ce265b5c-0dd8-4ef7-bd5c-281144592a24 req-4d355a7c-d1f9-408a-aa96-5dc954603230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ce265b5c-0dd8-4ef7-bd5c-281144592a24 req-4d355a7c-d1f9-408a-aa96-5dc954603230 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ce265b5c-0dd8-4ef7-bd5c-281144592a24 req-4d355a7c-d1f9-408a-aa96-5dc954603230 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ce265b5c-0dd8-4ef7-bd5c-281144592a24 req-4d355a7c-d1f9-408a-aa96-5dc954603230 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ce265b5c-0dd8-4ef7-bd5c-281144592a24 req-4d355a7c-d1f9-408a-aa96-5dc954603230 service nova] Creating event network-changed:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:36:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ce265b5c-0dd8-4ef7-bd5c-281144592a24 req-4d355a7c-d1f9-408a-aa96-5dc954603230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035700 Apr 12 03:36:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 114/341] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c1862e47-d8d8-4189-9a90-94c5e8cb422f tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462190 Apr 12 03:36:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 116/342] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:36:02 2023] POST /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-unplugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] Creating event network-vif-unplugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:36:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:36:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-05a1e7d8-a1a0-49c6-b937-94afeb2c5b9c req-637e4026-2221-4b66-af0c-1845c50c32d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029906 Apr 12 03:36:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 113/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:04 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f496e5fe694d46a9803f797743a7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cce206e2b94b03ade2d310373c5ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4c8e2dc5-5ebb-4619-b4dc-8eff45e9f07a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6" status: 200 len: 1544 microversion: 2.1 time: 0.170736 Apr 12 03:36:04 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:04 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 => generated 1544 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b6423fb7-5361-42df-ba98-fd2312027e17 req-e3e58ceb-f69b-4cb9-af0d-73190278fca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b6423fb7-5361-42df-ba98-fd2312027e17 req-e3e58ceb-f69b-4cb9-af0d-73190278fca3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b6423fb7-5361-42df-ba98-fd2312027e17 req-e3e58ceb-f69b-4cb9-af0d-73190278fca3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b6423fb7-5361-42df-ba98-fd2312027e17 req-e3e58ceb-f69b-4cb9-af0d-73190278fca3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b6423fb7-5361-42df-ba98-fd2312027e17 req-e3e58ceb-f69b-4cb9-af0d-73190278fca3 service nova] Creating event network-changed:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:36:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b6423fb7-5361-42df-ba98-fd2312027e17 req-e3e58ceb-f69b-4cb9-af0d-73190278fca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044685 Apr 12 03:36:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 117/345] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:36:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:36:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1b278d54-1f6a-4739-b4b3-fb8d37bee423 req-ba1028eb-0eab-4119-9d26-39a6023eb619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032839 Apr 12 03:36:06 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 114/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:10 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lazy-loading 'services' on Instance uuid 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:36:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-86e4dfa8-0d38-4157-9145-55bf3844c597 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-volume_attachments/8c45cb5c-d38a-4f37-959c-08611a51e9a8" status: 202 len: 0 microversion: 2.49 time: 0.160512 Apr 12 03:36:11 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 116/347] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 03:36:10 2023] DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-volume_attachments/8c45cb5c-d38a-4f37-959c-08611a51e9a8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=17 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:13 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-dba44164-f7f6-4550-b906-aa24f47058fc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-interface/1fcf28a7-3fd9-4283-a0df-be0377b96d42" status: 202 len: 0 microversion: 2.49 time: 0.056973 Apr 12 03:36:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 118/348] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 03:36:13 2023] DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-interface/1fcf28a7-3fd9-4283-a0df-be0377b96d42 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f1d72e39-07c5-4207-b20b-8da429fbbfa4 tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-instance-actions/req-dba44164-f7f6-4550-b906-aa24f47058fc" status: 200 len: 474 microversion: 2.49 time: 0.237184 Apr 12 03:36:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 115/349] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 03:36:13 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-instance-actions/req-dba44164-f7f6-4550-b906-aa24f47058fc => generated 474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:36:14 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-df096b6e-891a-49ac-8cda-e0aa94df0d35 req-9053cdd5-c0c6-40d2-b998-f9d5d7f59343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-unplugged", "status": "completed", "tag": "1fcf28a7-3fd9-4283-a0df-be0377b96d42"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:14 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=21 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-df096b6e-891a-49ac-8cda-e0aa94df0d35 req-9053cdd5-c0c6-40d2-b998-f9d5d7f59343 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-df096b6e-891a-49ac-8cda-e0aa94df0d35 req-9053cdd5-c0c6-40d2-b998-f9d5d7f59343 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-df096b6e-891a-49ac-8cda-e0aa94df0d35 req-9053cdd5-c0c6-40d2-b998-f9d5d7f59343 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:14 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-df096b6e-891a-49ac-8cda-e0aa94df0d35 req-9053cdd5-c0c6-40d2-b998-f9d5d7f59343 service nova] Creating event network-vif-unplugged:1fcf28a7-3fd9-4283-a0df-be0377b96d42 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:36:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-df096b6e-891a-49ac-8cda-e0aa94df0d35 req-9053cdd5-c0c6-40d2-b998-f9d5d7f59343 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037668 Apr 12 03:36:14 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 117/350] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-plugged", "status": "completed", "tag": "1fcf28a7-3fd9-4283-a0df-be0377b96d42"}, {"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-deleted", "tag": "1fcf28a7-3fd9-4283-a0df-be0377b96d42"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] Creating event network-vif-plugged:1fcf28a7-3fd9-4283-a0df-be0377b96d42 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:36:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] Creating event network-vif-deleted:1fcf28a7-3fd9-4283-a0df-be0377b96d42 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:36:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-279ef1bb-028f-4fad-a6eb-43dbe15583c9 req-cf92f910-7b25-4726-9f77-1f7f94a57b52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031351 Apr 12 03:36:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 119/351] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=21 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=39 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:19 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lazy-loading 'services' on Instance uuid 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:36:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a47fc0a1-df50-4a54-b859-2da8068f3981 tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f/os-volume_attachments/b48ff4ab-9969-4337-bce5-6dcdfced462a" status: 202 len: 0 microversion: 2.1 time: 0.173670 Apr 12 03:36:19 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 116/352] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:36:19 2023] DELETE /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f/os-volume_attachments/b48ff4ab-9969-4337-bce5-6dcdfced462a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:19 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:36:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1a04442b-a51a-477f-a620-1ed173632a4d tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f" status: 204 len: 0 microversion: 2.1 time: 0.147823 Apr 12 03:36:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 118/353] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:36:19 2023] DELETE /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84ea3a8776a944178ba5a04bce4d9b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f7b42b161f41efb234f0ce70210a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-466fb79b-22e5-427c-8d3d-739d742ac79b tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f" status: 200 len: 1547 microversion: 2.1 time: 0.170607 Apr 12 03:36:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 120/354] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:20 2023] GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:20 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-5ca69ca4-7148-49ba-9010-f217b335ed90 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1536 microversion: 2.1 time: 0.149385 Apr 12 03:36:20 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 117/355] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:20 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1536 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Searching by: {'deleted': False, 'project_id': '05e1e25933cd42df98fb060b8d2701dc'} {{(pid=62074) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62074]: DEBUG nova.compute.multi_cell_list [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=62074) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 03:36:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-545bd81c-b16f-4488-ad3a-75364b92eb76 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.203382 Apr 12 03:36:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 119/356] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 03:36:20 2023] GET /compute/v2.1/servers => generated 341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:20 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-18617f50-66e2-48af-8526-f05e52bfc546 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1536 microversion: 2.1 time: 0.173260 Apr 12 03:36:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 121/357] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:20 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1536 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:22 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-561cb056-3ee3-458c-b57a-19d2d75edd3e req-18874d17-8c48-4913-90dc-4755c145acfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f", "name": "network-vif-unplugged", "status": "completed", "tag": "e3161de1-7643-4b1a-8a0c-27791fed8dbd"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-561cb056-3ee3-458c-b57a-19d2d75edd3e req-18874d17-8c48-4913-90dc-4755c145acfb service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-561cb056-3ee3-458c-b57a-19d2d75edd3e req-18874d17-8c48-4913-90dc-4755c145acfb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-561cb056-3ee3-458c-b57a-19d2d75edd3e req-18874d17-8c48-4913-90dc-4755c145acfb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-561cb056-3ee3-458c-b57a-19d2d75edd3e req-18874d17-8c48-4913-90dc-4755c145acfb service nova] Creating event network-vif-unplugged:e3161de1-7643-4b1a-8a0c-27791fed8dbd for instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f on user Apr 12 03:36:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-561cb056-3ee3-458c-b57a-19d2d75edd3e req-18874d17-8c48-4913-90dc-4755c145acfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080913 Apr 12 03:36:22 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 118/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e52a442-8ea4-45e3-98eb-dc605d0d1d55"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:22 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9ab0c18f-14a4-4d83-8181-1fb3be87cfeb tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315823 Apr 12 03:36:22 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 120/359] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:36:22 2023] POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-fbfd4e41-1a5c-4c68-9c9d-1323ef07e038 req-e0e6c5c8-7742-435c-b5e0-bf4e780cb871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f", "name": "network-vif-deleted", "tag": "e3161de1-7643-4b1a-8a0c-27791fed8dbd"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fbfd4e41-1a5c-4c68-9c9d-1323ef07e038 req-e0e6c5c8-7742-435c-b5e0-bf4e780cb871 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fbfd4e41-1a5c-4c68-9c9d-1323ef07e038 req-e0e6c5c8-7742-435c-b5e0-bf4e780cb871 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fbfd4e41-1a5c-4c68-9c9d-1323ef07e038 req-e0e6c5c8-7742-435c-b5e0-bf4e780cb871 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-fbfd4e41-1a5c-4c68-9c9d-1323ef07e038 req-e0e6c5c8-7742-435c-b5e0-bf4e780cb871 service nova] Creating event network-vif-deleted:e3161de1-7643-4b1a-8a0c-27791fed8dbd for instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f on user Apr 12 03:36:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-fbfd4e41-1a5c-4c68-9c9d-1323ef07e038 req-e0e6c5c8-7742-435c-b5e0-bf4e780cb871 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062267 Apr 12 03:36:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 122/360] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:36:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-5c52b2be-cbb0-4a0c-85f8-c323168021f4 req-2282191c-e603-4ac2-abb8-5dcf87dbb443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f", "name": "network-vif-plugged", "status": "completed", "tag": "e3161de1-7643-4b1a-8a0c-27791fed8dbd"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-5c52b2be-cbb0-4a0c-85f8-c323168021f4 req-2282191c-e603-4ac2-abb8-5dcf87dbb443 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-5c52b2be-cbb0-4a0c-85f8-c323168021f4 req-2282191c-e603-4ac2-abb8-5dcf87dbb443 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-5c52b2be-cbb0-4a0c-85f8-c323168021f4 req-2282191c-e603-4ac2-abb8-5dcf87dbb443 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-5c52b2be-cbb0-4a0c-85f8-c323168021f4 req-2282191c-e603-4ac2-abb8-5dcf87dbb443 service nova] Creating event network-vif-plugged:e3161de1-7643-4b1a-8a0c-27791fed8dbd for instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f on user Apr 12 03:36:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-5c52b2be-cbb0-4a0c-85f8-c323168021f4 req-2282191c-e603-4ac2-abb8-5dcf87dbb443 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040668 Apr 12 03:36:24 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 119/361] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:31 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:31 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8848e445-3e32-4f4d-aaed-329894f958a6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1582 microversion: 2.1 time: 0.146971 Apr 12 03:36:31 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 121/362] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:31 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1582 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:33 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=9 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:33 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-50fb0fc7-c9c8-4a0a-bf12-31f259389ab9 req-3f64045d-9188-45a4-a343-776dfb3f2c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-50fb0fc7-c9c8-4a0a-bf12-31f259389ab9 req-3f64045d-9188-45a4-a343-776dfb3f2c23 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-50fb0fc7-c9c8-4a0a-bf12-31f259389ab9 req-3f64045d-9188-45a4-a343-776dfb3f2c23 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-50fb0fc7-c9c8-4a0a-bf12-31f259389ab9 req-3f64045d-9188-45a4-a343-776dfb3f2c23 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-50fb0fc7-c9c8-4a0a-bf12-31f259389ab9 req-3f64045d-9188-45a4-a343-776dfb3f2c23 service nova] Creating event network-changed:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:36:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-50fb0fc7-c9c8-4a0a-bf12-31f259389ab9 req-3f64045d-9188-45a4-a343-776dfb3f2c23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037439 Apr 12 03:36:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 123/363] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=7 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:34 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lazy-loading 'services' on Instance uuid 72ba1218-065d-40c4-8503-7c4155e47503 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:36:34 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-2019e5fc-7e69-410f-93da-8c77d47ca69c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments/d2e08409-6c4e-44ef-842b-29460b0cb939" status: 202 len: 0 microversion: 2.1 time: 0.185904 Apr 12 03:36:34 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 120/364] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:36:34 2023] DELETE /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments/d2e08409-6c4e-44ef-842b-29460b0cb939 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:34 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:34 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e7aa9c35-b6e6-45ba-8332-2ba76e8041f9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047494 Apr 12 03:36:34 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 122/365] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:36:34 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1375969825"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:35 user devstack@n-api.service[62072]: INFO nova.network.security_group_api [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Adding security group 1f9e5ce7-155f-450d-b2bf-da2b0507e9d8 to port a76c6f07-234b-4832-8ace-ec81656b06a7 Apr 12 03:36:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1e947142-ffef-4c0d-be7a-9aeab7d09d74 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/action" status: 202 len: 0 microversion: 2.1 time: 0.619776 Apr 12 03:36:35 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 124/366] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:36:35 2023] POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:36:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3af399a6-9b92-48d7-8592-2488e35e2656 req-e99763f9-2154-4789-9a0f-106bd5b12831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3af399a6-9b92-48d7-8592-2488e35e2656 req-e99763f9-2154-4789-9a0f-106bd5b12831 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3af399a6-9b92-48d7-8592-2488e35e2656 req-e99763f9-2154-4789-9a0f-106bd5b12831 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3af399a6-9b92-48d7-8592-2488e35e2656 req-e99763f9-2154-4789-9a0f-106bd5b12831 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3af399a6-9b92-48d7-8592-2488e35e2656 req-e99763f9-2154-4789-9a0f-106bd5b12831 service nova] Creating event network-changed:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:36:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3af399a6-9b92-48d7-8592-2488e35e2656 req-e99763f9-2154-4789-9a0f-106bd5b12831 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028003 Apr 12 03:36:35 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 123/367] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:35 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-91d89448-74e7-466d-9028-e689ea27646a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1747 microversion: 2.1 time: 0.257934 Apr 12 03:36:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 121/368] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:35 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1747 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-64c0ce43-1e28-484c-9919-6c6c45405e52 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048570 Apr 12 03:36:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 125/369] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 03:36:37 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e7c1f03b-f492-436b-8677-93dce35b7007 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 204 len: 0 microversion: 2.20 time: 0.123533 Apr 12 03:36:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 124/370] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:36:37 2023] DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-1622b8a6-1a3d-4f28-8e23-8f2a856ba007 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/action" status: 202 len: 0 microversion: 2.1 time: 0.100569 Apr 12 03:36:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 122/371] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:36:37 2023] POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:37 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e2571489-4541-43da-8543-5fc140bc1f6c tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 200 len: 1711 microversion: 2.20 time: 0.182934 Apr 12 03:36:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 126/372] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:36:37 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-428d2bc7-0656-4ff0-92e7-8da5a119bd98 req-6d5ec58f-76be-4895-b71e-c5e880a6de5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-unplugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:37 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-fd549654-b891-42f4-9ef7-88db0d5557e6 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1749 microversion: 2.1 time: 0.305978 Apr 12 03:36:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 125/373] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:37 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1749 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-428d2bc7-0656-4ff0-92e7-8da5a119bd98 req-6d5ec58f-76be-4895-b71e-c5e880a6de5e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-428d2bc7-0656-4ff0-92e7-8da5a119bd98 req-6d5ec58f-76be-4895-b71e-c5e880a6de5e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-428d2bc7-0656-4ff0-92e7-8da5a119bd98 req-6d5ec58f-76be-4895-b71e-c5e880a6de5e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-428d2bc7-0656-4ff0-92e7-8da5a119bd98 req-6d5ec58f-76be-4895-b71e-c5e880a6de5e service nova] Creating event network-vif-unplugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:36:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-428d2bc7-0656-4ff0-92e7-8da5a119bd98 req-6d5ec58f-76be-4895-b71e-c5e880a6de5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038899 Apr 12 03:36:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 123/374] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:38 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-260c10aa-6810-49aa-ab5c-ca38f8c04f4f req-11e81623-520f-4fed-a0f0-e1e40d1a0584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-unplugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-260c10aa-6810-49aa-ab5c-ca38f8c04f4f req-11e81623-520f-4fed-a0f0-e1e40d1a0584 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-260c10aa-6810-49aa-ab5c-ca38f8c04f4f req-11e81623-520f-4fed-a0f0-e1e40d1a0584 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-260c10aa-6810-49aa-ab5c-ca38f8c04f4f req-11e81623-520f-4fed-a0f0-e1e40d1a0584 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:38 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-260c10aa-6810-49aa-ab5c-ca38f8c04f4f req-11e81623-520f-4fed-a0f0-e1e40d1a0584 service nova] Creating event network-vif-unplugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:36:38 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-260c10aa-6810-49aa-ab5c-ca38f8c04f4f req-11e81623-520f-4fed-a0f0-e1e40d1a0584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038125 Apr 12 03:36:38 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 127/375] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-e3c49aa7-dbd7-40f5-b831-7a403f14486c req-48e6df8e-9187-4f5e-9481-ff3b65b5a7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-deleted", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e3c49aa7-dbd7-40f5-b831-7a403f14486c req-48e6df8e-9187-4f5e-9481-ff3b65b5a7d8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e3c49aa7-dbd7-40f5-b831-7a403f14486c req-48e6df8e-9187-4f5e-9481-ff3b65b5a7d8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e3c49aa7-dbd7-40f5-b831-7a403f14486c req-48e6df8e-9187-4f5e-9481-ff3b65b5a7d8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-e3c49aa7-dbd7-40f5-b831-7a403f14486c req-48e6df8e-9187-4f5e-9481-ff3b65b5a7d8 service nova] Creating event network-vif-deleted:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:36:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-e3c49aa7-dbd7-40f5-b831-7a403f14486c req-48e6df8e-9187-4f5e-9481-ff3b65b5a7d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035922 Apr 12 03:36:39 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:39 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-62a366f3-ed95-497b-9a80-194e84797f7f req-e6322069-3e38-4ddf-a213-7e2bc7431fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23d4bcd-989a-45e1-89a3-6e3d30229a32", "name": "network-vif-plugged", "status": "completed", "tag": "540b7307-8fea-4b50-bab8-626983135a96"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-62a366f3-ed95-497b-9a80-194e84797f7f req-e6322069-3e38-4ddf-a213-7e2bc7431fd7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-62a366f3-ed95-497b-9a80-194e84797f7f req-e6322069-3e38-4ddf-a213-7e2bc7431fd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-62a366f3-ed95-497b-9a80-194e84797f7f req-e6322069-3e38-4ddf-a213-7e2bc7431fd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-62a366f3-ed95-497b-9a80-194e84797f7f req-e6322069-3e38-4ddf-a213-7e2bc7431fd7 service nova] Creating event network-vif-plugged:540b7307-8fea-4b50-bab8-626983135a96 for instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 on user Apr 12 03:36:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-62a366f3-ed95-497b-9a80-194e84797f7f req-e6322069-3e38-4ddf-a213-7e2bc7431fd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029509 Apr 12 03:36:39 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 124/377] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-11ba383e-d33c-411f-877b-4ed58074b6e9 req-c01355dc-1a05-459b-b28d-fe02b8d2d319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-plugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-11ba383e-d33c-411f-877b-4ed58074b6e9 req-c01355dc-1a05-459b-b28d-fe02b8d2d319 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-11ba383e-d33c-411f-877b-4ed58074b6e9 req-c01355dc-1a05-459b-b28d-fe02b8d2d319 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-11ba383e-d33c-411f-877b-4ed58074b6e9 req-c01355dc-1a05-459b-b28d-fe02b8d2d319 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-11ba383e-d33c-411f-877b-4ed58074b6e9 req-c01355dc-1a05-459b-b28d-fe02b8d2d319 service nova] Creating event network-vif-plugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:36:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-11ba383e-d33c-411f-877b-4ed58074b6e9 req-c01355dc-1a05-459b-b28d-fe02b8d2d319 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 Apr 12 03:36:40 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 128/378] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-b2d56ad0-c24a-4b26-b7cc-c664fe7abd64 req-48a7ef7b-3aa3-48cf-911c-b7dcc2bcdc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-plugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b2d56ad0-c24a-4b26-b7cc-c664fe7abd64 req-48a7ef7b-3aa3-48cf-911c-b7dcc2bcdc3c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b2d56ad0-c24a-4b26-b7cc-c664fe7abd64 req-48a7ef7b-3aa3-48cf-911c-b7dcc2bcdc3c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b2d56ad0-c24a-4b26-b7cc-c664fe7abd64 req-48a7ef7b-3aa3-48cf-911c-b7dcc2bcdc3c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-b2d56ad0-c24a-4b26-b7cc-c664fe7abd64 req-48a7ef7b-3aa3-48cf-911c-b7dcc2bcdc3c service nova] Creating event network-vif-plugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:36:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-b2d56ad0-c24a-4b26-b7cc-c664fe7abd64 req-48a7ef7b-3aa3-48cf-911c-b7dcc2bcdc3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040136 Apr 12 03:36:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:43 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:43 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9e59a856-3154-4bc5-b993-141142c12b67 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1494 microversion: 2.1 time: 0.155957 Apr 12 03:36:43 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 125/380] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:43 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-e08fe44b-4274-4900-9503-795eb57fbaa7 req-da2ea682-8bc1-4299-8fd0-df2ec962664d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-plugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e08fe44b-4274-4900-9503-795eb57fbaa7 req-da2ea682-8bc1-4299-8fd0-df2ec962664d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e08fe44b-4274-4900-9503-795eb57fbaa7 req-da2ea682-8bc1-4299-8fd0-df2ec962664d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e08fe44b-4274-4900-9503-795eb57fbaa7 req-da2ea682-8bc1-4299-8fd0-df2ec962664d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-e08fe44b-4274-4900-9503-795eb57fbaa7 req-da2ea682-8bc1-4299-8fd0-df2ec962664d service nova] Creating event network-vif-plugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:36:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-e08fe44b-4274-4900-9503-795eb57fbaa7 req-da2ea682-8bc1-4299-8fd0-df2ec962664d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039036 Apr 12 03:36:45 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 129/381] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:36:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c84c9787-e70c-4934-b03d-0e2c4ef93822 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd/action" status: 202 len: 0 microversion: 2.87 time: 0.075240 Apr 12 03:36:51 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 128/382] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:36:51 2023] POST /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:51 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-feb6be12-5425-4129-a5d3-57bc6bb743af tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1762 microversion: 2.87 time: 0.247409 Apr 12 03:36:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 126/383] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:36:51 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1762 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:36:52 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-f062e545-4dcb-4653-861c-05d336d5e362 req-b8c647ed-224d-4f56-93e7-013335d7636e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-f062e545-4dcb-4653-861c-05d336d5e362 req-b8c647ed-224d-4f56-93e7-013335d7636e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-f062e545-4dcb-4653-861c-05d336d5e362 req-b8c647ed-224d-4f56-93e7-013335d7636e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-f062e545-4dcb-4653-861c-05d336d5e362 req-b8c647ed-224d-4f56-93e7-013335d7636e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-f062e545-4dcb-4653-861c-05d336d5e362 req-b8c647ed-224d-4f56-93e7-013335d7636e service nova] Creating event network-vif-unplugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-f062e545-4dcb-4653-861c-05d336d5e362 req-b8c647ed-224d-4f56-93e7-013335d7636e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030662 Apr 12 03:36:52 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Creating event network-vif-unplugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-f92ca8b3-9ea1-48af-bd0b-aba298006ff4 req-17cc4d8b-7a1b-44bb-8d85-e94365c1e566 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.050481 Apr 12 03:36:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 129/385] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b8b8260f-56c2-4374-a7d4-f8d7295742df tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 200 len: 1379 microversion: 2.1 time: 0.159116 Apr 12 03:36:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 127/386] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:56 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 1379 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-85b23df9-4b81-487d-a3b9-1a66d4cf5cd2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 200 len: 1379 microversion: 2.1 time: 0.175962 Apr 12 03:36:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 131/387] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:56 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 1379 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1bf55aa0-04ba-4f9e-87f5-361f518aaf87 req-43c2a83b-d5cb-456d-8e94-bbaf2c86fb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1bf55aa0-04ba-4f9e-87f5-361f518aaf87 req-43c2a83b-d5cb-456d-8e94-bbaf2c86fb84 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1bf55aa0-04ba-4f9e-87f5-361f518aaf87 req-43c2a83b-d5cb-456d-8e94-bbaf2c86fb84 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1bf55aa0-04ba-4f9e-87f5-361f518aaf87 req-43c2a83b-d5cb-456d-8e94-bbaf2c86fb84 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1bf55aa0-04ba-4f9e-87f5-361f518aaf87 req-43c2a83b-d5cb-456d-8e94-bbaf2c86fb84 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:36:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1bf55aa0-04ba-4f9e-87f5-361f518aaf87 req-43c2a83b-d5cb-456d-8e94-bbaf2c86fb84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027723 Apr 12 03:36:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 128/388] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:36:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1f154fc7-6e79-485f-a212-ec6c13c9a687 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 204 len: 0 microversion: 2.1 time: 0.156773 Apr 12 03:36:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:36:56 2023] DELETE /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:56 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:36:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-62f1269e-334d-4a8e-82a6-cf1578750459 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 200 len: 1385 microversion: 2.1 time: 0.182011 Apr 12 03:36:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 132/390] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:36:56 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 1385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:36:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-unplugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}, {"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-plugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}, {"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-plugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}, {"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-plugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}, {"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-unplugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}, {"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-plugged", "status": "completed", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}, {"server_uuid": "49d33636-1dbb-4863-b0f3-9f1578e23e67", "name": "network-vif-deleted", "tag": "93c27018-4ee9-42be-81a1-2b9377a689f5"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:36:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:36:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:36:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-unplugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-plugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-plugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-plugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-unplugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-plugged:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] Creating event network-vif-deleted:93c27018-4ee9-42be-81a1-2b9377a689f5 for instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 on user Apr 12 03:36:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-6803e734-9cfa-4515-b654-a4ce48511795 req-d2a2491d-0de5-489d-948d-be9e0c6383ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1213 microversion: 2.1 time: 0.036407 Apr 12 03:36:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 129/391] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 03:36:58 2023] POST /compute/v2.1/os-server-external-events => generated 1213 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a0455ac2-b4ff-495c-aaf8-c3021c700dd9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1659 microversion: 2.1 time: 0.157766 Apr 12 03:37:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:03 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1659 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-5847a2e1-efc0-45ab-ad2a-8f5e34f603ba tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-instance-actions/req-dba44164-f7f6-4550-b906-aa24f47058fc" status: 200 len: 503 microversion: 2.49 time: 0.078243 Apr 12 03:37:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 133/393] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 03:37:03 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-instance-actions/req-dba44164-f7f6-4550-b906-aa24f47058fc => generated 503 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ca0118b-5d36-40b7-bb39-806756144b3a"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e8e4ba63-4afe-4247-98f3-3c863213d63d tempest-TaggedAttachmentsTest-810597090 tempest-TaggedAttachmentsTest-810597090-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-instance-actions/req-dba44164-f7f6-4550-b906-aa24f47058fc" status: 200 len: 503 microversion: 2.49 time: 0.054700 Apr 12 03:37:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 132/394] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 03:37:03 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-instance-actions/req-dba44164-f7f6-4550-b906-aa24f47058fc => generated 503 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=49 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7f3eaffc-e2b0-4d83-b942-e7a9749a375e tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.042851 Apr 12 03:37:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 134/395] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 03:37:03 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9fabea37-f42e-4657-928a-98f2c0b37493 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272150 Apr 12 03:37:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 130/396] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:37:03 2023] POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:37:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6380d324-d280-4dfe-a882-15ef7c107f93 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 204 len: 0 microversion: 2.49 time: 0.115742 Apr 12 03:37:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 133/397] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:37:03 2023] DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=25 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a7c2b6c06a745de95fae59f8b02c06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a327d22640aa4a7caeb35fb0ed2dccc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:04 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-866ef1f0-3025-48c5-9803-bb9a73fd4046 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 200 len: 1748 microversion: 2.49 time: 0.173511 Apr 12 03:37:04 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 135/398] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:37:03 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:37:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7e3cda29-bd22-405b-87f1-6b94c1b803ae req-4d284b48-b2ac-40bf-bce6-f749685280f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-unplugged", "status": "completed", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7e3cda29-bd22-405b-87f1-6b94c1b803ae req-4d284b48-b2ac-40bf-bce6-f749685280f7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7e3cda29-bd22-405b-87f1-6b94c1b803ae req-4d284b48-b2ac-40bf-bce6-f749685280f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7e3cda29-bd22-405b-87f1-6b94c1b803ae req-4d284b48-b2ac-40bf-bce6-f749685280f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7e3cda29-bd22-405b-87f1-6b94c1b803ae req-4d284b48-b2ac-40bf-bce6-f749685280f7 service nova] Creating event network-vif-unplugged:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:37:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7e3cda29-bd22-405b-87f1-6b94c1b803ae req-4d284b48-b2ac-40bf-bce6-f749685280f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038139 Apr 12 03:37:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 131/399] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-bc2b26ef-9e40-45fa-b5fa-8adc0cbbfb6e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.086689 Apr 12 03:37:04 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:37:04 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-interface => generated 282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-a51edb7f-9713-409f-8ed1-6c4a1ff3ace4 req-38cc13f3-1def-4c26-a8b7-0477a4f88339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a51edb7f-9713-409f-8ed1-6c4a1ff3ace4 req-38cc13f3-1def-4c26-a8b7-0477a4f88339 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a51edb7f-9713-409f-8ed1-6c4a1ff3ace4 req-38cc13f3-1def-4c26-a8b7-0477a4f88339 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a51edb7f-9713-409f-8ed1-6c4a1ff3ace4 req-38cc13f3-1def-4c26-a8b7-0477a4f88339 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a51edb7f-9713-409f-8ed1-6c4a1ff3ace4 req-38cc13f3-1def-4c26-a8b7-0477a4f88339 service nova] Creating event network-changed:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:37:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-a51edb7f-9713-409f-8ed1-6c4a1ff3ace4 req-38cc13f3-1def-4c26-a8b7-0477a4f88339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Apr 12 03:37:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 136/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-plugged", "status": "completed", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}, {"server_uuid": "37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63", "name": "network-vif-deleted", "tag": "b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:06 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=27 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:06 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] Creating event network-vif-plugged:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:37:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] Creating event network-vif-deleted:b0b22dc0-c2cf-4aed-b5a2-a9bfddcd1958 for instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 on user Apr 12 03:37:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-6b2289ff-5f93-48d1-afef-8104e7b91e72 req-e948400e-de71-49dd-aded-601e329316de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036846 Apr 12 03:37:06 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 132/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c59a4756-2e14-4cf2-8c9d-e6da704aaa4b"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-43c29eb3-16e6-4d38-a5d3-2378314892e4 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275515 Apr 12 03:37:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 135/403] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:37:07 2023] POST /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] [instance: 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] HTTP exception thrown: Instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f could not be found. Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Request method failure captured: Apr 12 03:37:10 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f HTTP/1.1 Apr 12 03:37:10 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:37:10 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:37:10 user devstack@n-api.service[62072]: Connection: close Apr 12 03:37:10 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:37:10 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:37:10 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:37:10 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:37:10 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiXrKtpOi6wfXYyDm3Wp61jM-OU6tYkmAw65cV_RcAjiHjhIfW82TDOpkoMRNAh2X8eIY0T3DCSN9gaGBdmHqk8AVff_jY41sOYWciRlwHOw1ST1QEfri0fu-E1IAjvCdC-411wOxR3UhRHxj6hVYBsA4fLYFgCxJUQtfGwUpy2aB-M Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Project-Id: 86f7b42b161f41efb234f0ce70210a08 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1513599190 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f7b42b161f41efb234f0ce70210a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f7b42b161f41efb234f0ce70210a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f7b42b161f41efb234f0ce70210a08"}]}] Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesSnapshotTestJSON-1513599190 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Tenant-Id: 86f7b42b161f41efb234f0ce70210a08 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1513599190 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-User: tempest-VolumesSnapshotTestJSON-1513599190-project-member Apr 12 03:37:10 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:37:10 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:37:10 user devstack@n-api.service[62072]: X-User-Id: 84ea3a8776a944178ba5a04bce4d9b05 Apr 12 03:37:10 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesSnapshotTestJSON-1513599190-project-member Apr 12 03:37:10 user devstack@n-api.service[62072]: method: > Apr 12 03:37:10 user devstack@n-api.service[62072]: exception: Instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f could not be found. Apr 12 03:37:10 user devstack@n-api.service[62072]: action_args: {'id': '3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f'} Apr 12 03:37:10 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f could not be found. Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f could not be found. Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f could not be found. Apr 12 03:37:10 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] Returning 404 to user: Instance 3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-870f2882-3536-4a87-98f8-77d59703e49c tempest-VolumesSnapshotTestJSON-1513599190 tempest-VolumesSnapshotTestJSON-1513599190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f" status: 404 len: 111 microversion: 2.1 time: 0.031677 Apr 12 03:37:10 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 137/404] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:10 2023] GET /compute/v2.1/servers/3ea6c8a8-e6d1-4095-8b7b-5df7bf82c61f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:11 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-83aa3b15-436b-400d-be12-4036e260b124 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1705 microversion: 2.1 time: 0.155716 Apr 12 03:37:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 133/405] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:11 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1705 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1847743592", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: dict_keys(['metadata_items']) {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: dict_keys(['metadata_items']) {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4e14b227-2d89-457b-a704-f5c851caba6e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/action" status: 202 len: 1161 microversion: 2.1 time: 0.361236 Apr 12 03:37:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 136/406] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 03:37:11 2023] POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/action => generated 1161 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:12 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d388e7b8-efa4-414f-85aa-7f3d1154671a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1733 microversion: 2.1 time: 0.202387 Apr 12 03:37:12 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 138/407] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:12 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1733 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:12 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-82d8e0bc-5d51-4fc1-b825-3b6fcb41fa42 req-a2d77430-38c9-4a9e-ae0a-fb0c04936da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-unplugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-82d8e0bc-5d51-4fc1-b825-3b6fcb41fa42 req-a2d77430-38c9-4a9e-ae0a-fb0c04936da8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-82d8e0bc-5d51-4fc1-b825-3b6fcb41fa42 req-a2d77430-38c9-4a9e-ae0a-fb0c04936da8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-82d8e0bc-5d51-4fc1-b825-3b6fcb41fa42 req-a2d77430-38c9-4a9e-ae0a-fb0c04936da8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-82d8e0bc-5d51-4fc1-b825-3b6fcb41fa42 req-a2d77430-38c9-4a9e-ae0a-fb0c04936da8 service nova] Creating event network-vif-unplugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-82d8e0bc-5d51-4fc1-b825-3b6fcb41fa42 req-a2d77430-38c9-4a9e-ae0a-fb0c04936da8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040934 Apr 12 03:37:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 134/408] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e00ce6d5-710f-42ed-a38b-0c183564a609"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] HTTP exception thrown: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. Apr 12 03:37:14 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Request method failure captured: Apr 12 03:37:14 user devstack@n-api.service[62074]: request: PUT /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments/c59a4756-2e14-4cf2-8c9d-e6da704aaa4b HTTP/1.1 Apr 12 03:37:14 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:37:14 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:37:14 user devstack@n-api.service[62074]: Connection: close Apr 12 03:37:14 user devstack@n-api.service[62074]: Content-Length: 74 Apr 12 03:37:14 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:37:14 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:37:14 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:37:14 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibvypmSwHVTIX6j9qyx-TrIPIXXvLkSfT_TOMa9RxBWaNXJ4npnvUBPBCQUa96rGiumv120FoOqIVrQLMVqvp6oB1n8HI1XOvfRUseg_SHO6Nm--zTq_wfBBjn_lKIpUGjFv-edZhViG31rQf1E8T3o-dqEOBzdc3oIhtQ3ZPFgbjY Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Project-Id: 7a0eff14d5f4440fba76d4ac24d7c5e6 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesAdminNegativeTest-419567243 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Role: admin,reader,member Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Roles: admin,reader,member Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a0eff14d5f4440fba76d4ac24d7c5e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a0eff14d5f4440fba76d4ac24d7c5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a0eff14d5f4440fba76d4ac24d7c5e6"}]}] Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesAdminNegativeTest-419567243 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Tenant-Id: 7a0eff14d5f4440fba76d4ac24d7c5e6 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-419567243 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-User: tempest-VolumesAdminNegativeTest-419567243-project-admin Apr 12 03:37:14 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:37:14 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:37:14 user devstack@n-api.service[62074]: X-User-Id: 69cba176942248ba9f3c4ebc017b37c5 Apr 12 03:37:14 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesAdminNegativeTest-419567243-project-admin Apr 12 03:37:14 user devstack@n-api.service[62074]: Apr 12 03:37:14 user devstack@n-api.service[62074]: {"volumeAttachment": {"volumeId": "e00ce6d5-710f-42ed-a38b-0c183564a609"}} Apr 12 03:37:14 user devstack@n-api.service[62074]: method: > Apr 12 03:37:14 user devstack@n-api.service[62074]: exception: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. Apr 12 03:37:14 user devstack@n-api.service[62074]: action_args: {'server_id': 'a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6', 'id': 'c59a4756-2e14-4cf2-8c9d-e6da704aaa4b', 'body': {'volumeAttachment': {'volumeId': 'e00ce6d5-710f-42ed-a38b-0c183564a609'}}} Apr 12 03:37:14 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. (HTTP 404) (Request-ID: req-949ed8e2-9aef-4e45-ab75-de36ea991f28) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. Apr 12 03:37:14 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:14 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Returning 400 to user: Volume e00ce6d5-710f-42ed-a38b-0c183564a609 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e8392833-a055-489b-a487-41debdf20a66 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments/c59a4756-2e14-4cf2-8c9d-e6da704aaa4b" status: 400 len: 107 microversion: 2.1 time: 0.228445 Apr 12 03:37:14 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 137/409] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 03:37:13 2023] PUT /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments/c59a4756-2e14-4cf2-8c9d-e6da704aaa4b => generated 107 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:14 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lazy-loading 'services' on Instance uuid a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:37:14 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e6caaaa3-ce7e-4f3f-a284-932c90087515 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments/c59a4756-2e14-4cf2-8c9d-e6da704aaa4b" status: 202 len: 0 microversion: 2.1 time: 0.172353 Apr 12 03:37:14 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 139/410] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:37:14 2023] DELETE /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments/c59a4756-2e14-4cf2-8c9d-e6da704aaa4b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:14 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-aefe360b-dc1c-4042-9ca5-ed0a60a1e502 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063866 Apr 12 03:37:14 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 135/411] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:37:14 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:14 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}, {"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}, {"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}, {"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-unplugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}, {"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Creating event network-vif-unplugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3ab09148-d743-40d2-8364-dd098bd6e5a1 req-2ca08e21-1b3b-4af6-9c66-41e45a5e7bb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032499 Apr 12 03:37:14 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:14 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-7b18dd4d-e9c4-45b9-ba15-671baefb81e6 req-3ee94319-cfc0-4aa6-9862-4d18e8373236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7b18dd4d-e9c4-45b9-ba15-671baefb81e6 req-3ee94319-cfc0-4aa6-9862-4d18e8373236 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7b18dd4d-e9c4-45b9-ba15-671baefb81e6 req-3ee94319-cfc0-4aa6-9862-4d18e8373236 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7b18dd4d-e9c4-45b9-ba15-671baefb81e6 req-3ee94319-cfc0-4aa6-9862-4d18e8373236 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-7b18dd4d-e9c4-45b9-ba15-671baefb81e6 req-3ee94319-cfc0-4aa6-9862-4d18e8373236 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-7b18dd4d-e9c4-45b9-ba15-671baefb81e6 req-3ee94319-cfc0-4aa6-9862-4d18e8373236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039812 Apr 12 03:37:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 140/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=7 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=15 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-aba06293-fb79-4967-bc18-cf5ae2d3c62c tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053645 Apr 12 03:37:25 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 136/414] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:37:25 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:37:25 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:25 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:DELETE=1,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:25 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ba4996c3-c5c6-4204-84da-f141e010f71e req-5db1c070-31f8-4a65-835a-0395b4384522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ba4996c3-c5c6-4204-84da-f141e010f71e req-5db1c070-31f8-4a65-835a-0395b4384522 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ba4996c3-c5c6-4204-84da-f141e010f71e req-5db1c070-31f8-4a65-835a-0395b4384522 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ba4996c3-c5c6-4204-84da-f141e010f71e req-5db1c070-31f8-4a65-835a-0395b4384522 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ba4996c3-c5c6-4204-84da-f141e010f71e req-5db1c070-31f8-4a65-835a-0395b4384522 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:37:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ba4996c3-c5c6-4204-84da-f141e010f71e req-5db1c070-31f8-4a65-835a-0395b4384522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070588 Apr 12 03:37:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-baed3339-8d92-41c4-aaf4-5e0a26be46dd tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '.version_select at 0x7f76a6aa0160>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-baed3339-8d92-41c4-aaf4-5e0a26be46dd tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca" status: 204 len: 0 microversion: 2.1 time: 0.258906 Apr 12 03:37:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 141/416] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:27 2023] DELETE /compute/v2.1/images/3edad615-4b98-4e15-bf3e-72fa0b622eca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:37:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] HTTP exception thrown: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Request method failure captured: Apr 12 03:37:27 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 HTTP/1.1 Apr 12 03:37:27 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:37:27 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:37:27 user devstack@n-api.service[62074]: Connection: close Apr 12 03:37:27 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:37:27 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:37:27 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:37:27 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:37:27 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW38GTamOXCQK3iLzQyd9xC8xQx3su8ZJP2KboKP83FRi7ZOWd5CMPGGdF_Hq6lRyWej0-22mpUj-JqUNrIbw_M5ifzJlALH8RTdbeWIO2cMtTbFaiAfDBApf1OoT2ZfG6PE3Qz5SC5LyDPd5y5OCG5ynVr8wVRkHno9F5Ci50vxu8 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Project-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738ebb6b798c4974aa46f9bbe3828279"}]}] Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Tenant-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:37:27 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:37:27 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:37:27 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:37:27 user devstack@n-api.service[62074]: X-User-Id: de1fe5db01624224ab7b615c908d990b Apr 12 03:37:27 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:37:27 user devstack@n-api.service[62074]: method: > Apr 12 03:37:27 user devstack@n-api.service[62074]: exception: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:37:27 user devstack@n-api.service[62074]: action_args: {'id': 'b23d4bcd-989a-45e1-89a3-6e3d30229a32'} Apr 12 03:37:27 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:37:27 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Returning 404 to user: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-84e7232c-6302-4449-94da-f55561be1ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 404 len: 111 microversion: 2.20 time: 0.032048 Apr 12 03:37:27 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 140/417] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:37:27 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-88130456-a84d-415d-bfa4-45c4298770e6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '.version_select at 0x7f76a6aa1480>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-88130456-a84d-415d-bfa4-45c4298770e6 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892402082" status: 204 len: 0 microversion: 2.20 time: 0.033762 Apr 12 03:37:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 142/418] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 03:37:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892402082 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:37:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d97fac59-4f29-4f08-8ae9-ab36499200ff tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 204 len: 0 microversion: 2.1 time: 0.150187 Apr 12 03:37:27 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 137/419] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:37:27 2023] DELETE /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:28 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9405e57e55e84976b0caeba84e3aef62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a027d7708e6747fe970c388d6ba66359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a12378cf-9019-4a0e-9ef1-bf50c78c07ef tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 200 len: 1676 microversion: 2.1 time: 0.227004 Apr 12 03:37:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 141/420] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:27 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:28 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:28 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7b5d1b42-70e3-42e5-99f6-9c62bc5d5cd6 req-ec10a11b-9ca0-4e27-a258-acbe2fbe5a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-unplugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7b5d1b42-70e3-42e5-99f6-9c62bc5d5cd6 req-ec10a11b-9ca0-4e27-a258-acbe2fbe5a90 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7b5d1b42-70e3-42e5-99f6-9c62bc5d5cd6 req-ec10a11b-9ca0-4e27-a258-acbe2fbe5a90 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7b5d1b42-70e3-42e5-99f6-9c62bc5d5cd6 req-ec10a11b-9ca0-4e27-a258-acbe2fbe5a90 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c8631254-26f6-4b32-a226-0fc0addce9a5 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1747 microversion: 2.1 time: 0.243344 Apr 12 03:37:28 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 143/421] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:27 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1747 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7b5d1b42-70e3-42e5-99f6-9c62bc5d5cd6 req-ec10a11b-9ca0-4e27-a258-acbe2fbe5a90 service nova] Creating event network-vif-unplugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7b5d1b42-70e3-42e5-99f6-9c62bc5d5cd6 req-ec10a11b-9ca0-4e27-a258-acbe2fbe5a90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048836 Apr 12 03:37:28 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 138/422] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a5560ec2-bfa7-44b7-af43-34cfc40ab6ff tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'create', calling method: .version_select at 0x7f76a69a0280>, body: {"keypair": {"name": "tempest-keypair-2125155953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV0Ykds0yE0AtGhC79nOfa8CiixAX+fWYFS4r0KbDrdX/eto3bHX8KjkQpgbhQK4OVD9q33q1+I1pg47ZtrC8YTjrFvz5r71kp0Qd9KtUm3DHiDVGrOt+n/RWN+EIIG+w=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:28 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-a5560ec2-bfa7-44b7-af43-34cfc40ab6ff tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:37:28 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-a5560ec2-bfa7-44b7-af43-34cfc40ab6ff tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for user de1fe5db01624224ab7b615c908d990b and project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:37:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a5560ec2-bfa7-44b7-af43-34cfc40ab6ff tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057553 Apr 12 03:37:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 142/423] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 03:37:28 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 03:37:30 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-unplugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-plugged", "status": "completed", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}, {"server_uuid": "72ba1218-065d-40c4-8503-7c4155e47503", "name": "network-vif-deleted", "tag": "cff588d4-f46a-4d44-a3e6-1c04f6abd380"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Creating event network-vif-unplugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Creating event network-vif-plugged:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] Creating event network-vif-deleted:cff588d4-f46a-4d44-a3e6-1c04f6abd380 for instance 72ba1218-065d-40c4-8503-7c4155e47503 on user Apr 12 03:37:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-4b56003e-ddb5-4b24-92ce-6d124c783671 req-2e963d54-5f7a-4167-b6df-d8fa21a22dfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.031978 Apr 12 03:37:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 144/424] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-405065337", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "638ee582-4cac-44e7-b703-386f5116e8a3"}], "security_groups": [{"name": "tempest-securitygroup--881362000"}], "key_name": "tempest-keypair-2125155953", "user_data": "}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] validate_networks() for [('638ee582-4cac-44e7-b703-386f5116e8a3', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Getting quotas for user de1fe5db01624224ab7b615c908d990b and project 738ebb6b798c4974aa46f9bbe3828279. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:37:30 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:37:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8f6278c8-d7c6-49f7-91e2-8af6d58a32f3 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.594115 Apr 12 03:37:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 139/425] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:37:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:37:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-23b380e6-003d-48c3-a8c7-4f0e8d05dc1b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:30 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-23b380e6-003d-48c3-a8c7-4f0e8d05dc1b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:30 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-23b380e6-003d-48c3-a8c7-4f0e8d05dc1b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:30 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-23b380e6-003d-48c3-a8c7-4f0e8d05dc1b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:30 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-23b380e6-003d-48c3-a8c7-4f0e8d05dc1b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-23b380e6-003d-48c3-a8c7-4f0e8d05dc1b tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1275 microversion: 2.20 time: 0.071540 Apr 12 03:37:30 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 143/426] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:37:30 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1275 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:37:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-fbfecbcf-46e6-46a5-9e8d-a72a36616c8e req-115b93f0-56bd-4fd2-8243-12ab438209d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fbfecbcf-46e6-46a5-9e8d-a72a36616c8e req-115b93f0-56bd-4fd2-8243-12ab438209d0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fbfecbcf-46e6-46a5-9e8d-a72a36616c8e req-115b93f0-56bd-4fd2-8243-12ab438209d0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fbfecbcf-46e6-46a5-9e8d-a72a36616c8e req-115b93f0-56bd-4fd2-8243-12ab438209d0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-fbfecbcf-46e6-46a5-9e8d-a72a36616c8e req-115b93f0-56bd-4fd2-8243-12ab438209d0 service nova] Creating event network-changed:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:37:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-fbfecbcf-46e6-46a5-9e8d-a72a36616c8e req-115b93f0-56bd-4fd2-8243-12ab438209d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034933 Apr 12 03:37:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 145/427] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-0c5897c4-7d34-4a7f-9073-bf9f6dd6f7a6 req-8c9f8444-002e-4058-88b0-d8d4b1a2a13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-plugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0c5897c4-7d34-4a7f-9073-bf9f6dd6f7a6 req-8c9f8444-002e-4058-88b0-d8d4b1a2a13c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0c5897c4-7d34-4a7f-9073-bf9f6dd6f7a6 req-8c9f8444-002e-4058-88b0-d8d4b1a2a13c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0c5897c4-7d34-4a7f-9073-bf9f6dd6f7a6 req-8c9f8444-002e-4058-88b0-d8d4b1a2a13c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-0c5897c4-7d34-4a7f-9073-bf9f6dd6f7a6 req-8c9f8444-002e-4058-88b0-d8d4b1a2a13c service nova] Creating event network-vif-plugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:37:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-0c5897c4-7d34-4a7f-9073-bf9f6dd6f7a6 req-8c9f8444-002e-4058-88b0-d8d4b1a2a13c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042234 Apr 12 03:37:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 140/428] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-64a2bd2f-0a0a-408a-b3c2-e90cc05a913d req-126bbedb-7e6b-46cd-a771-844bde80d373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-plugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-64a2bd2f-0a0a-408a-b3c2-e90cc05a913d req-126bbedb-7e6b-46cd-a771-844bde80d373 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-64a2bd2f-0a0a-408a-b3c2-e90cc05a913d req-126bbedb-7e6b-46cd-a771-844bde80d373 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-64a2bd2f-0a0a-408a-b3c2-e90cc05a913d req-126bbedb-7e6b-46cd-a771-844bde80d373 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-64a2bd2f-0a0a-408a-b3c2-e90cc05a913d req-126bbedb-7e6b-46cd-a771-844bde80d373 service nova] Creating event network-vif-plugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:37:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-64a2bd2f-0a0a-408a-b3c2-e90cc05a913d req-126bbedb-7e6b-46cd-a771-844bde80d373 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 Apr 12 03:37:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 144/429] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:41 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-26a1bbd1-ef23-4ca8-9945-6769aacef45b tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1768 microversion: 2.87 time: 0.158232 Apr 12 03:37:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 146/430] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:37:41 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1768 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:37:45 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:45 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4f6916cd-2959-495a-8fc3-ee93dfd0e116 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1390658566", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "destination_type": "local"}, {"source_type": "volume", "uuid": "c3c1bcb1-fa5e-4ce0-9323-9cb951c0a383", "destination_type": "invalid"}], "networks": [{"uuid": "1a483654-b740-4544-84c9-53a41c11fa88"}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4f6916cd-2959-495a-8fc3-ee93dfd0e116 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Request method failure captured: Apr 12 03:37:45 user devstack@n-api.service[62073]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 03:37:45 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:37:45 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:37:45 user devstack@n-api.service[62073]: Connection: close Apr 12 03:37:45 user devstack@n-api.service[62073]: Content-Length: 494 Apr 12 03:37:45 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:37:45 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:37:45 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:37:45 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW-rc7civ_odPK9fyl4-33cQIMenMhNmAY7Y18_9Dd_879WZycL_PiYcvkjCm7KQKY4Vdsybvjmv587cHOpOG6kXI1UAYyznsH8NfV_ceBu-avh0fLQQumXWg4ceJHFVIQKPj4EYHfyWsXUKFjosFwb5_sfx_TmNIO7qcwLEG8kTV4 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Project-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83a7ef3f97fd47849973d4e4482fb5f9"}]}] Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Tenant: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Tenant-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-User: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:37:45 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:37:45 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:37:45 user devstack@n-api.service[62073]: X-User-Id: 3da7394c51664a7caacfda6b7dda9066 Apr 12 03:37:45 user devstack@n-api.service[62073]: X-User-Name: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:37:45 user devstack@n-api.service[62073]: Apr 12 03:37:45 user devstack@n-api.service[62073]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1390658566", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "destination_type": "local"}, {"source_type": "volume", "uuid": "c3c1bcb1-fa5e-4ce0-9323-9cb951c0a383", "destination_type": "invalid"}], "networks": [{"uuid": "1a483654-b740-4544-84c9-53a41c11fa88"}]}} Apr 12 03:37:45 user devstack@n-api.service[62073]: method: > Apr 12 03:37:45 user devstack@n-api.service[62073]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 03:37:45 user devstack@n-api.service[62073]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1390658566', 'imageRef': 'e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c3c1bcb1-fa5e-4ce0-9323-9cb951c0a383', 'destination_type': 'invalid'}], 'networks': [{'uuid': '1a483654-b740-4544-84c9-53a41c11fa88'}]}}} Apr 12 03:37:45 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise error Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 03:37:45 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4f6916cd-2959-495a-8fc3-ee93dfd0e116 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:45 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4f6916cd-2959-495a-8fc3-ee93dfd0e116 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012518 Apr 12 03:37:45 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 141/431] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:37:44 2023] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:45 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:45 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2142a250-150f-4360-a615-e34b836c5f78 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1494 microversion: 2.1 time: 0.169378 Apr 12 03:37:45 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 145/432] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:45 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1494 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:37:46 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 HTTP/1.1 Apr 12 03:37:46 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:37:46 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:37:46 user devstack@n-api.service[62072]: Connection: close Apr 12 03:37:46 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:37:46 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:37:46 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:37:46 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:37:46 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:37:46 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:46 user devstack@n-api.service[62072]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:37:46 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:37:46 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:37:46 user devstack@n-api.service[62072]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:37:46 user devstack@n-api.service[62072]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:37:46 user devstack@n-api.service[62072]: method: > Apr 12 03:37:46 user devstack@n-api.service[62072]: exception: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62072]: action_args: {'id': '49d33636-1dbb-4863-b0f3-9f1578e23e67'} Apr 12 03:37:46 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-2e5e1c80-91c5-4e41-b38d-a64141fa8910 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 404 len: 111 microversion: 2.1 time: 0.028556 Apr 12 03:37:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 147/433] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:46 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:37:46 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 HTTP/1.1 Apr 12 03:37:46 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:37:46 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:37:46 user devstack@n-api.service[62073]: Connection: close Apr 12 03:37:46 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:37:46 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:37:46 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:37:46 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:37:46 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:37:46 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:46 user devstack@n-api.service[62073]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:37:46 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:37:46 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:37:46 user devstack@n-api.service[62073]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:37:46 user devstack@n-api.service[62073]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:37:46 user devstack@n-api.service[62073]: method: > Apr 12 03:37:46 user devstack@n-api.service[62073]: exception: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62073]: action_args: {'id': '49d33636-1dbb-4863-b0f3-9f1578e23e67'} Apr 12 03:37:46 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:46 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:37:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-83e7a0fe-fd1d-4752-bed2-f21ef9c1f6d6 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 404 len: 111 microversion: 2.1 time: 0.039891 Apr 12 03:37:46 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 142/434] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:37:46 2023] DELETE /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 49d33636-1dbb-4863-b0f3-9f1578e23e67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:37:47 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 HTTP/1.1 Apr 12 03:37:47 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:37:47 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:37:47 user devstack@n-api.service[62074]: Connection: close Apr 12 03:37:47 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:37:47 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:37:47 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:37:47 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:37:47 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:37:47 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:37:47 user devstack@n-api.service[62074]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:37:47 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:37:47 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:37:47 user devstack@n-api.service[62074]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:37:47 user devstack@n-api.service[62074]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:37:47 user devstack@n-api.service[62074]: method: > Apr 12 03:37:47 user devstack@n-api.service[62074]: exception: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:47 user devstack@n-api.service[62074]: action_args: {'id': '49d33636-1dbb-4863-b0f3-9f1578e23e67'} Apr 12 03:37:47 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. Apr 12 03:37:47 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 49d33636-1dbb-4863-b0f3-9f1578e23e67 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9bf91673-e643-4365-9d41-c71a2cbb5e0c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67" status: 404 len: 111 microversion: 2.1 time: 0.028859 Apr 12 03:37:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 146/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:46 2023] GET /compute/v2.1/servers/49d33636-1dbb-4863-b0f3-9f1578e23e67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-966703655", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "fa33fb38-f437-49cf-b0b6-b5f9e9cbb8cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "397a8299-6fbd-4bac-97a1-c8cc31fa2e0e"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] validate_networks() for [('397a8299-6fbd-4bac-97a1-c8cc31fa2e0e', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:37:52 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa33fb38-f437-49cf-b0b6-b5f9e9cbb8cf',volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:37:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ebbefb56-445c-40e7-8f07-6570f3679afe tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.824523 Apr 12 03:37:52 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 148/436] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:37:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:37:52 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-056db3ab-44ef-40a5-8652-1b544f0471ec tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:52 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-056db3ab-44ef-40a5-8652-1b544f0471ec tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:52 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-056db3ab-44ef-40a5-8652-1b544f0471ec tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:37:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-056db3ab-44ef-40a5-8652-1b544f0471ec tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 200 len: 1065 microversion: 2.1 time: 0.099941 Apr 12 03:37:52 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 143/437] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:37:52 2023] GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 1065 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] HTTP exception thrown: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Request method failure captured: Apr 12 03:37:54 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 HTTP/1.1 Apr 12 03:37:54 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:37:54 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:37:54 user devstack@n-api.service[62074]: Connection: close Apr 12 03:37:54 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:37:54 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:37:54 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:37:54 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:37:54 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiad7rPNdETYjeQiRHzbtc5zvtQtD52_5dwMYGtJrDrGdjazfGG2vdaBal3B1eTU-G-YEAP0Te7D0Oziy827ChRN3Q5deDy_HkYjYOONnNtVUNzYwpne9ZW-rkPvir7A8GXVRUcGdLO2k2VqXMC4H3L2pl1mQ51rWGmkBRumeiv97b4 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Project-Id: a327d22640aa4a7caeb35fb0ed2dccc8 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Project-Name: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a327d22640aa4a7caeb35fb0ed2dccc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a327d22640aa4a7caeb35fb0ed2dccc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a327d22640aa4a7caeb35fb0ed2dccc8"}]}] Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Tenant: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Tenant-Id: a327d22640aa4a7caeb35fb0ed2dccc8 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:54 user devstack@n-api.service[62074]: X-User: tempest-TaggedAttachmentsTest-1144278074-project-member Apr 12 03:37:54 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:37:54 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:37:54 user devstack@n-api.service[62074]: X-User-Id: 3a7c2b6c06a745de95fae59f8b02c06d Apr 12 03:37:54 user devstack@n-api.service[62074]: X-User-Name: tempest-TaggedAttachmentsTest-1144278074-project-member Apr 12 03:37:54 user devstack@n-api.service[62074]: method: > Apr 12 03:37:54 user devstack@n-api.service[62074]: exception: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:54 user devstack@n-api.service[62074]: action_args: {'id': '37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63'} Apr 12 03:37:54 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Returning 404 to user: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c896218b-6fe9-4d99-994a-c7048e80c8f6 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 404 len: 111 microversion: 2.49 time: 0.036708 Apr 12 03:37:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 147/438] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:37:54 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:37:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-65277639-c40a-43a3-8135-1ca775cf83cc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '.version_select at 0x7f76a6bed3f0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-65277639-c40a-43a3-8135-1ca775cf83cc tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52848813" status: 204 len: 0 microversion: 2.49 time: 0.022896 Apr 12 03:37:54 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 149/439] 10.0.0.210 () {64 vars in 1333 bytes} [Wed Apr 12 03:37:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52848813 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:37:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-a747c40b-3563-4151-beae-108b033df07d req-86db0e4e-1b97-4d1c-b4f2-c7f7af860811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eef2c91-dfad-43aa-b193-25970db83b79", "tag": "50b78ba6-f017-4643-a2ec-fa0f348bb270"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:37:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a747c40b-3563-4151-beae-108b033df07d req-86db0e4e-1b97-4d1c-b4f2-c7f7af860811 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a747c40b-3563-4151-beae-108b033df07d req-86db0e4e-1b97-4d1c-b4f2-c7f7af860811 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a747c40b-3563-4151-beae-108b033df07d req-86db0e4e-1b97-4d1c-b4f2-c7f7af860811 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a747c40b-3563-4151-beae-108b033df07d req-86db0e4e-1b97-4d1c-b4f2-c7f7af860811 service nova] Creating event network-changed:50b78ba6-f017-4643-a2ec-fa0f348bb270 for instance 1eef2c91-dfad-43aa-b193-25970db83b79 on user Apr 12 03:37:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-a747c40b-3563-4151-beae-108b033df07d req-86db0e4e-1b97-4d1c-b4f2-c7f7af860811 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033686 Apr 12 03:37:55 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 144/440] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] HTTP exception thrown: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Request method failure captured: Apr 12 03:37:55 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 HTTP/1.1 Apr 12 03:37:55 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:37:55 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:37:55 user devstack@n-api.service[62074]: Connection: close Apr 12 03:37:55 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:37:55 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:37:55 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:37:55 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:37:55 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiad7rPNdETYjeQiRHzbtc5zvtQtD52_5dwMYGtJrDrGdjazfGG2vdaBal3B1eTU-G-YEAP0Te7D0Oziy827ChRN3Q5deDy_HkYjYOONnNtVUNzYwpne9ZW-rkPvir7A8GXVRUcGdLO2k2VqXMC4H3L2pl1mQ51rWGmkBRumeiv97b4 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Project-Id: a327d22640aa4a7caeb35fb0ed2dccc8 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Project-Name: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a327d22640aa4a7caeb35fb0ed2dccc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a327d22640aa4a7caeb35fb0ed2dccc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a327d22640aa4a7caeb35fb0ed2dccc8"}]}] Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Tenant: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Tenant-Id: a327d22640aa4a7caeb35fb0ed2dccc8 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:55 user devstack@n-api.service[62074]: X-User: tempest-TaggedAttachmentsTest-1144278074-project-member Apr 12 03:37:55 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:37:55 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:37:55 user devstack@n-api.service[62074]: X-User-Id: 3a7c2b6c06a745de95fae59f8b02c06d Apr 12 03:37:55 user devstack@n-api.service[62074]: X-User-Name: tempest-TaggedAttachmentsTest-1144278074-project-member Apr 12 03:37:55 user devstack@n-api.service[62074]: method: > Apr 12 03:37:55 user devstack@n-api.service[62074]: exception: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62074]: action_args: {'id': '37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63'} Apr 12 03:37:55 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Returning 404 to user: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ad27b0b0-ef2b-42e7-a1f6-b68375fb4fb8 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 404 len: 111 microversion: 2.49 time: 0.032098 Apr 12 03:37:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 148/441] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:37:55 2023] DELETE /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] [instance: 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:37:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] HTTP exception thrown: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Request method failure captured: Apr 12 03:37:55 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 HTTP/1.1 Apr 12 03:37:55 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:37:55 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:37:55 user devstack@n-api.service[62072]: Connection: close Apr 12 03:37:55 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:37:55 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:37:55 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:37:55 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:37:55 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiad7rPNdETYjeQiRHzbtc5zvtQtD52_5dwMYGtJrDrGdjazfGG2vdaBal3B1eTU-G-YEAP0Te7D0Oziy827ChRN3Q5deDy_HkYjYOONnNtVUNzYwpne9ZW-rkPvir7A8GXVRUcGdLO2k2VqXMC4H3L2pl1mQ51rWGmkBRumeiv97b4 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Project-Id: a327d22640aa4a7caeb35fb0ed2dccc8 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Project-Name: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a327d22640aa4a7caeb35fb0ed2dccc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a327d22640aa4a7caeb35fb0ed2dccc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a327d22640aa4a7caeb35fb0ed2dccc8"}]}] Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Tenant: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Tenant-Id: a327d22640aa4a7caeb35fb0ed2dccc8 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1144278074 Apr 12 03:37:55 user devstack@n-api.service[62072]: X-User: tempest-TaggedAttachmentsTest-1144278074-project-member Apr 12 03:37:55 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:37:55 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:37:55 user devstack@n-api.service[62072]: X-User-Id: 3a7c2b6c06a745de95fae59f8b02c06d Apr 12 03:37:55 user devstack@n-api.service[62072]: X-User-Name: tempest-TaggedAttachmentsTest-1144278074-project-member Apr 12 03:37:55 user devstack@n-api.service[62072]: method: > Apr 12 03:37:55 user devstack@n-api.service[62072]: exception: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62072]: action_args: {'id': '37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63'} Apr 12 03:37:55 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. Apr 12 03:37:55 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:37:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] Returning 404 to user: Instance 37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:37:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a79031df-c278-497e-a552-0ff2b79107f0 tempest-TaggedAttachmentsTest-1144278074 tempest-TaggedAttachmentsTest-1144278074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63" status: 404 len: 111 microversion: 2.49 time: 0.027486 Apr 12 03:37:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 150/442] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:37:55 2023] GET /compute/v2.1/servers/37b9eee6-8f7b-4e74-bfc7-6e94dc8b3b63 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:38:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b8d9b030-7afc-4b30-997d-393970f5bb59 req-95bb28c6-6c2b-4609-aec4-a331ba20b287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eef2c91-dfad-43aa-b193-25970db83b79", "name": "network-vif-plugged", "status": "completed", "tag": "50b78ba6-f017-4643-a2ec-fa0f348bb270"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b8d9b030-7afc-4b30-997d-393970f5bb59 req-95bb28c6-6c2b-4609-aec4-a331ba20b287 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b8d9b030-7afc-4b30-997d-393970f5bb59 req-95bb28c6-6c2b-4609-aec4-a331ba20b287 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b8d9b030-7afc-4b30-997d-393970f5bb59 req-95bb28c6-6c2b-4609-aec4-a331ba20b287 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b8d9b030-7afc-4b30-997d-393970f5bb59 req-95bb28c6-6c2b-4609-aec4-a331ba20b287 service nova] Creating event network-vif-plugged:50b78ba6-f017-4643-a2ec-fa0f348bb270 for instance 1eef2c91-dfad-43aa-b193-25970db83b79 on user Apr 12 03:38:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b8d9b030-7afc-4b30-997d-393970f5bb59 req-95bb28c6-6c2b-4609-aec4-a331ba20b287 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039301 Apr 12 03:38:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 145/443] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=25 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:02 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-688ea6e4-b394-4f50-8043-2b062c2f1302 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1724 microversion: 2.1 time: 0.333190 Apr 12 03:38:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 149/444] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:02 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:38:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c609c787-f27f-46c0-9da6-8b6bca01be02 req-2ddb58a1-45a8-4f20-b024-b3f690e4a8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eef2c91-dfad-43aa-b193-25970db83b79", "name": "network-vif-plugged", "status": "completed", "tag": "50b78ba6-f017-4643-a2ec-fa0f348bb270"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c609c787-f27f-46c0-9da6-8b6bca01be02 req-2ddb58a1-45a8-4f20-b024-b3f690e4a8e9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c609c787-f27f-46c0-9da6-8b6bca01be02 req-2ddb58a1-45a8-4f20-b024-b3f690e4a8e9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c609c787-f27f-46c0-9da6-8b6bca01be02 req-2ddb58a1-45a8-4f20-b024-b3f690e4a8e9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c609c787-f27f-46c0-9da6-8b6bca01be02 req-2ddb58a1-45a8-4f20-b024-b3f690e4a8e9 service nova] Creating event network-vif-plugged:50b78ba6-f017-4643-a2ec-fa0f348bb270 for instance 1eef2c91-dfad-43aa-b193-25970db83b79 on user Apr 12 03:38:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c609c787-f27f-46c0-9da6-8b6bca01be02 req-2ddb58a1-45a8-4f20-b024-b3f690e4a8e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Apr 12 03:38:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 151/445] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-405f3229-db29-4385-b830-825af9c6342a tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073567 Apr 12 03:38:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 146/446] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:38:04 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:38:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1560370789", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "263f9508-8639-4289-9210-f9807acf6766"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:04 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] validate_networks() for [('263f9508-8639-4289-9210-f9807acf6766', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Getting quotas for project f4cce206e2b94b03ade2d310373c5ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Getting quotas for user e2f496e5fe694d46a9803f797743a7dc and project f4cce206e2b94b03ade2d310373c5ca2. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:38:05 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:38:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-44195801-72c7-47f1-b2b5-ca33678dd4d7 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.609062 Apr 12 03:38:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 150/447] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:38:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:38:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2fea8273-ad9d-495b-a60a-12d93277222f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:05 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-2fea8273-ad9d-495b-a60a-12d93277222f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:05 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-2fea8273-ad9d-495b-a60a-12d93277222f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f496e5fe694d46a9803f797743a7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cce206e2b94b03ade2d310373c5ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-2fea8273-ad9d-495b-a60a-12d93277222f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7" status: 200 len: 1212 microversion: 2.1 time: 0.085945 Apr 12 03:38:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 152/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:05 2023] GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:38:10 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-2847e9e4-9470-48a7-a467-669bb069727d req-41d1f112-cfc3-4bb3-9dc2-f600af2a35e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5a7005-6dd4-491a-a55c-db7a82dc28f7", "tag": "a460c7a2-ed31-445e-a2a8-296e5163084b"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-2847e9e4-9470-48a7-a467-669bb069727d req-41d1f112-cfc3-4bb3-9dc2-f600af2a35e7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-2847e9e4-9470-48a7-a467-669bb069727d req-41d1f112-cfc3-4bb3-9dc2-f600af2a35e7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-2847e9e4-9470-48a7-a467-669bb069727d req-41d1f112-cfc3-4bb3-9dc2-f600af2a35e7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-2847e9e4-9470-48a7-a467-669bb069727d req-41d1f112-cfc3-4bb3-9dc2-f600af2a35e7 service nova] Creating event network-changed:a460c7a2-ed31-445e-a2a8-296e5163084b for instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 on user Apr 12 03:38:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-2847e9e4-9470-48a7-a467-669bb069727d req-41d1f112-cfc3-4bb3-9dc2-f600af2a35e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047074 Apr 12 03:38:10 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 147/449] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c349e4b9-0efc-41ac-a388-fb14cf938f10 req-8e9a0408-5caf-497b-8b11-2f36c6c57241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7005-6dd4-491a-a55c-db7a82dc28f7", "name": "network-vif-plugged", "status": "completed", "tag": "a460c7a2-ed31-445e-a2a8-296e5163084b"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c349e4b9-0efc-41ac-a388-fb14cf938f10 req-8e9a0408-5caf-497b-8b11-2f36c6c57241 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c349e4b9-0efc-41ac-a388-fb14cf938f10 req-8e9a0408-5caf-497b-8b11-2f36c6c57241 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c349e4b9-0efc-41ac-a388-fb14cf938f10 req-8e9a0408-5caf-497b-8b11-2f36c6c57241 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c349e4b9-0efc-41ac-a388-fb14cf938f10 req-8e9a0408-5caf-497b-8b11-2f36c6c57241 service nova] Creating event network-vif-plugged:a460c7a2-ed31-445e-a2a8-296e5163084b for instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 on user Apr 12 03:38:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c349e4b9-0efc-41ac-a388-fb14cf938f10 req-8e9a0408-5caf-497b-8b11-2f36c6c57241 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040075 Apr 12 03:38:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 151/450] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-79170971-b9f1-49cf-a05d-2dfffd004e13 req-2a9fa1aa-ed49-4f2c-adfa-316235bbdbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7005-6dd4-491a-a55c-db7a82dc28f7", "name": "network-vif-plugged", "status": "completed", "tag": "a460c7a2-ed31-445e-a2a8-296e5163084b"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:15 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=13 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:15 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-79170971-b9f1-49cf-a05d-2dfffd004e13 req-2a9fa1aa-ed49-4f2c-adfa-316235bbdbaf service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-79170971-b9f1-49cf-a05d-2dfffd004e13 req-2a9fa1aa-ed49-4f2c-adfa-316235bbdbaf service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-79170971-b9f1-49cf-a05d-2dfffd004e13 req-2a9fa1aa-ed49-4f2c-adfa-316235bbdbaf service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-79170971-b9f1-49cf-a05d-2dfffd004e13 req-2a9fa1aa-ed49-4f2c-adfa-316235bbdbaf service nova] Creating event network-vif-plugged:a460c7a2-ed31-445e-a2a8-296e5163084b for instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 on user Apr 12 03:38:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-79170971-b9f1-49cf-a05d-2dfffd004e13 req-2a9fa1aa-ed49-4f2c-adfa-316235bbdbaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039337 Apr 12 03:38:15 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 153/451] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] [instance: 72ba1218-065d-40c4-8503-7c4155e47503] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=15 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=15 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:18 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] HTTP exception thrown: Instance 72ba1218-065d-40c4-8503-7c4155e47503 could not be found. Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Request method failure captured: Apr 12 03:38:18 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 HTTP/1.1 Apr 12 03:38:18 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:38:18 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:38:18 user devstack@n-api.service[62073]: Connection: close Apr 12 03:38:18 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:38:18 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:38:18 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:38:18 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:38:18 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW-UOggkIen0OzLfbBNqMvITAc_EXh76-EcZATRew2HUUSYAhnM0duuCoYdeCVjnZsUX_cCOJqTwusfV5taA1x0uiP7v6iT2nm6sHwRp7XrgeqZE4OGRjUfXLSiYWtYt79CyIlNlEC15cDxXbamvMSN9PtXwdyP5obH2F8-hAF_NFY Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Project-Id: a027d7708e6747fe970c388d6ba66359 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerStableDeviceRescueTest-744520899 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a027d7708e6747fe970c388d6ba66359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a027d7708e6747fe970c388d6ba66359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a027d7708e6747fe970c388d6ba66359"}]}] Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerStableDeviceRescueTest-744520899 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Tenant-Id: a027d7708e6747fe970c388d6ba66359 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-744520899 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-User: tempest-ServerStableDeviceRescueTest-744520899-project-member Apr 12 03:38:18 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:38:18 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:38:18 user devstack@n-api.service[62073]: X-User-Id: 9405e57e55e84976b0caeba84e3aef62 Apr 12 03:38:18 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerStableDeviceRescueTest-744520899-project-member Apr 12 03:38:18 user devstack@n-api.service[62073]: method: > Apr 12 03:38:18 user devstack@n-api.service[62073]: exception: Instance 72ba1218-065d-40c4-8503-7c4155e47503 could not be found. Apr 12 03:38:18 user devstack@n-api.service[62073]: action_args: {'id': '72ba1218-065d-40c4-8503-7c4155e47503'} Apr 12 03:38:18 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ba1218-065d-40c4-8503-7c4155e47503 could not be found. Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ba1218-065d-40c4-8503-7c4155e47503 could not be found. Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ba1218-065d-40c4-8503-7c4155e47503 could not be found. Apr 12 03:38:18 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:18 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Returning 404 to user: Instance 72ba1218-065d-40c4-8503-7c4155e47503 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:38:18 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-18646feb-3154-46ed-b935-9702d796bee9 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503" status: 404 len: 111 microversion: 2.1 time: 0.036724 Apr 12 03:38:18 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 148/452] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:18 2023] GET /compute/v2.1/servers/72ba1218-065d-40c4-8503-7c4155e47503 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:38:18 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:18 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:18 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2af51160-0760-4e28-b5a7-2ead08435157 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] Calling method '.version_select at 0x7f76a69a1870>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:18 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2af51160-0760-4e28-b5a7-2ead08435157 tempest-ServerStableDeviceRescueTest-744520899 tempest-ServerStableDeviceRescueTest-744520899-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31851495" status: 202 len: 0 microversion: 2.1 time: 0.031860 Apr 12 03:38:18 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 152/453] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 03:38:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31851495 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:21 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-30ddedff-065b-47b2-b6e4-ae56f8459674 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1585 microversion: 2.20 time: 0.338121 Apr 12 03:38:21 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 154/454] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:38:21 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1585 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1375969825"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:28 user devstack@n-api.service[62073]: INFO nova.network.security_group_api [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Removing security group 1f9e5ce7-155f-450d-b2bf-da2b0507e9d8 from port a76c6f07-234b-4832-8ace-ec81656b06a7 Apr 12 03:38:29 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-92930e57-424e-44a9-9f46-74bd5689db5d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/action" status: 202 len: 0 microversion: 2.1 time: 0.930729 Apr 12 03:38:29 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 149/455] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:38:28 2023] POST /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:38:29 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c2d2a0ca-fa4b-4964-ba6d-0050ced191ab req-dbd0ace7-f09f-4b00-bdab-68181306fde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:29 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=9 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:29 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c2d2a0ca-fa4b-4964-ba6d-0050ced191ab req-dbd0ace7-f09f-4b00-bdab-68181306fde7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c2d2a0ca-fa4b-4964-ba6d-0050ced191ab req-dbd0ace7-f09f-4b00-bdab-68181306fde7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c2d2a0ca-fa4b-4964-ba6d-0050ced191ab req-dbd0ace7-f09f-4b00-bdab-68181306fde7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:29 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c2d2a0ca-fa4b-4964-ba6d-0050ced191ab req-dbd0ace7-f09f-4b00-bdab-68181306fde7 service nova] Creating event network-changed:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:38:29 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c2d2a0ca-fa4b-4964-ba6d-0050ced191ab req-dbd0ace7-f09f-4b00-bdab-68181306fde7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038647 Apr 12 03:38:29 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 153/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:30 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-cf757f78-d0ec-49a4-b5a7-9afc20f442ad req-71fdfc01-854f-4faa-be8e-a19646583634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cf757f78-d0ec-49a4-b5a7-9afc20f442ad req-71fdfc01-854f-4faa-be8e-a19646583634 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cf757f78-d0ec-49a4-b5a7-9afc20f442ad req-71fdfc01-854f-4faa-be8e-a19646583634 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cf757f78-d0ec-49a4-b5a7-9afc20f442ad req-71fdfc01-854f-4faa-be8e-a19646583634 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cf757f78-d0ec-49a4-b5a7-9afc20f442ad req-71fdfc01-854f-4faa-be8e-a19646583634 service nova] Creating event network-changed:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:38:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-cf757f78-d0ec-49a4-b5a7-9afc20f442ad req-71fdfc01-854f-4faa-be8e-a19646583634 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032850 Apr 12 03:38:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 155/457] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:30 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lazy-loading 'services' on Instance uuid 23367b24-0a3b-454d-901d-8a3e5396333a {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:38:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d9a9c876-1619-4c33-bb49-f5670e700edf tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments/7e52a442-8ea4-45e3-98eb-dc605d0d1d55" status: 202 len: 0 microversion: 2.1 time: 0.174168 Apr 12 03:38:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 150/458] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:38:30 2023] DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments/7e52a442-8ea4-45e3-98eb-dc605d0d1d55 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-270c0df4-4cd5-437c-bc2f-ec76c8475b38 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050590 Apr 12 03:38:30 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 154/459] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:38:30 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-861319ca-48c4-4c5d-b475-56afe8927660 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: .version_select at 0x7f76a6bef370>, body: {"keypair": {"name": "tempest-keypair-1411992271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS13JiPBnpwy6hWDJrnaZHwuwdL5vH5nyF6/MTnPZMJQcLak2kXYJ42hH5AmlQraI/A/u9o/w1zAFpUYDoJwJLsZ7venHMIO1i9s9kjpJA5JVZMg0XUxqXqwfxeNoHNZQ=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:32 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-861319ca-48c4-4c5d-b475-56afe8927660 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:38:32 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-861319ca-48c4-4c5d-b475-56afe8927660 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:38:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-861319ca-48c4-4c5d-b475-56afe8927660 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165029 Apr 12 03:38:32 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 156/460] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:38:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:33 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1062487719", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ddbce990-4cfa-40bd-b1e1-fc1531789074"}], "security_groups": [{"name": "tempest-securitygroup--562237934"}], "key_name": "tempest-keypair-1411992271", "user_data": "}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:33 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] validate_networks() for [('ddbce990-4cfa-40bd-b1e1-fc1531789074', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:38:34 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:38:34 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-82612336-b62e-4dbc-8265-398d14d2f6c7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.552643 Apr 12 03:38:34 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 151/461] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:38:33 2023] POST /compute/v2.1/servers => generated 399 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:38:34 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2ae5089f-965f-48bb-a7ec-9b42ce1908ee tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:34 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2ae5089f-965f-48bb-a7ec-9b42ce1908ee tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:34 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-2ae5089f-965f-48bb-a7ec-9b42ce1908ee tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:34 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2ae5089f-965f-48bb-a7ec-9b42ce1908ee tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 200 len: 1236 microversion: 2.1 time: 0.063893 Apr 12 03:38:34 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 155/462] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:34 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:38:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-2654fcf2-719d-4247-9d74-81c99c25c708 req-2d49d7c6-f9fa-46aa-b3f5-f774571b803b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2654fcf2-719d-4247-9d74-81c99c25c708 req-2d49d7c6-f9fa-46aa-b3f5-f774571b803b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2654fcf2-719d-4247-9d74-81c99c25c708 req-2d49d7c6-f9fa-46aa-b3f5-f774571b803b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2654fcf2-719d-4247-9d74-81c99c25c708 req-2d49d7c6-f9fa-46aa-b3f5-f774571b803b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2654fcf2-719d-4247-9d74-81c99c25c708 req-2d49d7c6-f9fa-46aa-b3f5-f774571b803b service nova] Creating event network-changed:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:38:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-2654fcf2-719d-4247-9d74-81c99c25c708 req-2d49d7c6-f9fa-46aa-b3f5-f774571b803b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030167 Apr 12 03:38:36 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 157/463] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:38 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-c721772c-ff6b-47bc-9151-5034453422c5 req-3d20544a-ae76-4a92-ab66-83db768caa5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "name": "network-vif-plugged", "status": "completed", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c721772c-ff6b-47bc-9151-5034453422c5 req-3d20544a-ae76-4a92-ab66-83db768caa5a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c721772c-ff6b-47bc-9151-5034453422c5 req-3d20544a-ae76-4a92-ab66-83db768caa5a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c721772c-ff6b-47bc-9151-5034453422c5 req-3d20544a-ae76-4a92-ab66-83db768caa5a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c721772c-ff6b-47bc-9151-5034453422c5 req-3d20544a-ae76-4a92-ab66-83db768caa5a service nova] Creating event network-vif-plugged:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:38:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-c721772c-ff6b-47bc-9151-5034453422c5 req-3d20544a-ae76-4a92-ab66-83db768caa5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029490 Apr 12 03:38:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 152/464] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-41f9d095-fb92-4ae4-840e-436b1e2b1e67 req-1627c191-ffc2-42d8-8deb-e858fcad72ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "name": "network-vif-plugged", "status": "completed", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-41f9d095-fb92-4ae4-840e-436b1e2b1e67 req-1627c191-ffc2-42d8-8deb-e858fcad72ac service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-41f9d095-fb92-4ae4-840e-436b1e2b1e67 req-1627c191-ffc2-42d8-8deb-e858fcad72ac service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-41f9d095-fb92-4ae4-840e-436b1e2b1e67 req-1627c191-ffc2-42d8-8deb-e858fcad72ac service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-41f9d095-fb92-4ae4-840e-436b1e2b1e67 req-1627c191-ffc2-42d8-8deb-e858fcad72ac service nova] Creating event network-vif-plugged:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:38:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-41f9d095-fb92-4ae4-840e-436b1e2b1e67 req-1627c191-ffc2-42d8-8deb-e858fcad72ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041449 Apr 12 03:38:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 156/465] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-752552685", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] validate_networks() for [('f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for user d99be569057f432484e4a60b46882bbd and project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:38:42 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:38:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-5bc92262-fb64-42b7-9dd9-54482883ebd5 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.598804 Apr 12 03:38:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 158/466] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:38:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:38:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f6d220e2-ef0e-4abf-b2ba-732619868dc9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:42 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f6d220e2-ef0e-4abf-b2ba-732619868dc9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:42 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f6d220e2-ef0e-4abf-b2ba-732619868dc9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:42 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f6d220e2-ef0e-4abf-b2ba-732619868dc9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:42 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f6d220e2-ef0e-4abf-b2ba-732619868dc9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f6d220e2-ef0e-4abf-b2ba-732619868dc9 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8" status: 200 len: 1394 microversion: 2.87 time: 0.118657 Apr 12 03:38:42 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 153/467] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:38:42 2023] GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 => generated 1394 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:43 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:43 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1d3f9012-c69d-4521-a716-dd74121aa06d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 200 len: 1392 microversion: 2.1 time: 0.167542 Apr 12 03:38:43 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 157/468] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:43 2023] GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:38:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-71fdf42e-afaf-4c55-95fb-ef7a4d985a36 req-2df015a8-2e36-4b3a-98e4-d160ce0d8aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4407f4-e078-4777-a110-cb3f922be2e8", "tag": "aec6d617-eb2b-42b3-8cce-f21de7c1b91c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-71fdf42e-afaf-4c55-95fb-ef7a4d985a36 req-2df015a8-2e36-4b3a-98e4-d160ce0d8aa4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-71fdf42e-afaf-4c55-95fb-ef7a4d985a36 req-2df015a8-2e36-4b3a-98e4-d160ce0d8aa4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-71fdf42e-afaf-4c55-95fb-ef7a4d985a36 req-2df015a8-2e36-4b3a-98e4-d160ce0d8aa4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:45 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=15 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-71fdf42e-afaf-4c55-95fb-ef7a4d985a36 req-2df015a8-2e36-4b3a-98e4-d160ce0d8aa4 service nova] Creating event network-changed:aec6d617-eb2b-42b3-8cce-f21de7c1b91c for instance 3d4407f4-e078-4777-a110-cb3f922be2e8 on user Apr 12 03:38:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-71fdf42e-afaf-4c55-95fb-ef7a4d985a36 req-2df015a8-2e36-4b3a-98e4-d160ce0d8aa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033151 Apr 12 03:38:45 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 159/469] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-a6f3e5e8-1818-425d-8f3f-53791e5891ab req-d7b77858-4c6e-44a4-a814-e585861adc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4407f4-e078-4777-a110-cb3f922be2e8", "name": "network-vif-plugged", "status": "completed", "tag": "aec6d617-eb2b-42b3-8cce-f21de7c1b91c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:47 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a6f3e5e8-1818-425d-8f3f-53791e5891ab req-d7b77858-4c6e-44a4-a814-e585861adc9a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a6f3e5e8-1818-425d-8f3f-53791e5891ab req-d7b77858-4c6e-44a4-a814-e585861adc9a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a6f3e5e8-1818-425d-8f3f-53791e5891ab req-d7b77858-4c6e-44a4-a814-e585861adc9a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a6f3e5e8-1818-425d-8f3f-53791e5891ab req-d7b77858-4c6e-44a4-a814-e585861adc9a service nova] Creating event network-vif-plugged:aec6d617-eb2b-42b3-8cce-f21de7c1b91c for instance 3d4407f4-e078-4777-a110-cb3f922be2e8 on user Apr 12 03:38:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-a6f3e5e8-1818-425d-8f3f-53791e5891ab req-d7b77858-4c6e-44a4-a814-e585861adc9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047857 Apr 12 03:38:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 154/470] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] HTTP exception thrown: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Request method failure captured: Apr 12 03:38:49 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c HTTP/1.1 Apr 12 03:38:49 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:38:49 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:38:49 user devstack@n-api.service[62074]: Connection: close Apr 12 03:38:49 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:38:49 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:38:49 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:38:49 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:38:49 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW-rc7civ_odPK9fyl4-33cQIMenMhNmAY7Y18_9Dd_879WZycL_PiYcvkjCm7KQKY4Vdsybvjmv587cHOpOG6kXI1UAYyznsH8NfV_ceBu-avh0fLQQumXWg4ceJHFVIQKPj4EYHfyWsXUKFjosFwb5_sfx_TmNIO7qcwLEG8kTV4 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Project-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83a7ef3f97fd47849973d4e4482fb5f9"}]}] Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Tenant: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Tenant-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-User: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:38:49 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:38:49 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:38:49 user devstack@n-api.service[62074]: X-User-Id: 3da7394c51664a7caacfda6b7dda9066 Apr 12 03:38:49 user devstack@n-api.service[62074]: X-User-Name: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:38:49 user devstack@n-api.service[62074]: method: > Apr 12 03:38:49 user devstack@n-api.service[62074]: exception: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62074]: action_args: {'id': 'f728398d-524b-4f22-b91b-a431d62a952c'} Apr 12 03:38:49 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Returning 404 to user: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:38:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-bc8e44e2-6686-4805-bdcd-faf3ed2a63d0 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 404 len: 111 microversion: 2.1 time: 0.030610 Apr 12 03:38:49 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 158/471] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:38:49 2023] DELETE /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:38:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1208948809", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "3ec59075-3409-4372-a0ca-6283a5d56ca0"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: f728398d-524b-4f22-b91b-a431d62a952c] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:49 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] HTTP exception thrown: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Request method failure captured: Apr 12 03:38:49 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c HTTP/1.1 Apr 12 03:38:49 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:38:49 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:38:49 user devstack@n-api.service[62073]: Connection: close Apr 12 03:38:49 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:38:49 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:38:49 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:38:49 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:38:49 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW-rc7civ_odPK9fyl4-33cQIMenMhNmAY7Y18_9Dd_879WZycL_PiYcvkjCm7KQKY4Vdsybvjmv587cHOpOG6kXI1UAYyznsH8NfV_ceBu-avh0fLQQumXWg4ceJHFVIQKPj4EYHfyWsXUKFjosFwb5_sfx_TmNIO7qcwLEG8kTV4 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Project-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83a7ef3f97fd47849973d4e4482fb5f9"}]}] Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Tenant: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Tenant-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-User: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:38:49 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:38:49 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:38:49 user devstack@n-api.service[62073]: X-User-Id: 3da7394c51664a7caacfda6b7dda9066 Apr 12 03:38:49 user devstack@n-api.service[62073]: X-User-Name: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:38:49 user devstack@n-api.service[62073]: method: > Apr 12 03:38:49 user devstack@n-api.service[62073]: exception: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62073]: action_args: {'id': 'f728398d-524b-4f22-b91b-a431d62a952c'} Apr 12 03:38:49 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. Apr 12 03:38:49 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:38:49 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Returning 404 to user: Instance f728398d-524b-4f22-b91b-a431d62a952c could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:38:49 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cbf97d0e-c171-459e-be3a-703e6eb5d0de tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c" status: 404 len: 111 microversion: 2.1 time: 0.044264 Apr 12 03:38:49 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 155/472] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:49 2023] GET /compute/v2.1/servers/f728398d-524b-4f22-b91b-a431d62a952c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:38:49 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] validate_networks() for [('3ec59075-3409-4372-a0ca-6283a5d56ca0', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:49 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:38:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ec0840cc-1c5a-4b41-bc91-0bb98f789892 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 204 len: 0 microversion: 2.1 time: 0.128709 Apr 12 03:38:49 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 159/473] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:38:49 2023] DELETE /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-29675f90-6324-47fd-8364-5bbffb55d952 req-1fe9c6af-1be3-40f0-9001-5e92963c233d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4407f4-e078-4777-a110-cb3f922be2e8", "name": "network-vif-plugged", "status": "completed", "tag": "aec6d617-eb2b-42b3-8cce-f21de7c1b91c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-29675f90-6324-47fd-8364-5bbffb55d952 req-1fe9c6af-1be3-40f0-9001-5e92963c233d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-29675f90-6324-47fd-8364-5bbffb55d952 req-1fe9c6af-1be3-40f0-9001-5e92963c233d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-29675f90-6324-47fd-8364-5bbffb55d952 req-1fe9c6af-1be3-40f0-9001-5e92963c233d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-29675f90-6324-47fd-8364-5bbffb55d952 req-1fe9c6af-1be3-40f0-9001-5e92963c233d service nova] Creating event network-vif-plugged:aec6d617-eb2b-42b3-8cce-f21de7c1b91c for instance 3d4407f4-e078-4777-a110-cb3f922be2e8 on user Apr 12 03:38:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-29675f90-6324-47fd-8364-5bbffb55d952 req-1fe9c6af-1be3-40f0-9001-5e92963c233d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038877 Apr 12 03:38:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 160/474] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7394c51664a7caacfda6b7dda9066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a7ef3f97fd47849973d4e4482fb5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-11caa77a-638c-49a7-bb7f-15b6417cc586 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 200 len: 1500 microversion: 2.1 time: 0.185664 Apr 12 03:38:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 156/475] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:49 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 1500 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-d46efd5c-f113-4e7a-8324-999c701e0267 req-fa2f9b32-1ee5-44ef-837c-3c13187a1d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56834002-7593-4592-a86d-23bb90d00be0", "name": "network-vif-unplugged", "status": "completed", "tag": "8f7b221a-25ae-41f9-847d-5aedf2d93a71"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-d46efd5c-f113-4e7a-8324-999c701e0267 req-fa2f9b32-1ee5-44ef-837c-3c13187a1d6b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-d46efd5c-f113-4e7a-8324-999c701e0267 req-fa2f9b32-1ee5-44ef-837c-3c13187a1d6b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-d46efd5c-f113-4e7a-8324-999c701e0267 req-fa2f9b32-1ee5-44ef-837c-3c13187a1d6b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-d46efd5c-f113-4e7a-8324-999c701e0267 req-fa2f9b32-1ee5-44ef-837c-3c13187a1d6b service nova] Creating event network-vif-unplugged:8f7b221a-25ae-41f9-847d-5aedf2d93a71 for instance 56834002-7593-4592-a86d-23bb90d00be0 on user Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:38:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-d46efd5c-f113-4e7a-8324-999c701e0267 req-fa2f9b32-1ee5-44ef-837c-3c13187a1d6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065875 Apr 12 03:38:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 161/476] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Getting quotas for project f4f984af8c7048c7ba68c1530be9cc8d. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Getting quotas for user 45fe6fed1a5a43e5bd0925b92486ec68 and project f4f984af8c7048c7ba68c1530be9cc8d. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:38:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:38:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1a7d8570-597f-47cc-a481-4dac33f03845 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.635285 Apr 12 03:38:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 160/477] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:38:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f19fc621-9c78-4259-897b-8fd0b0399096 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f19fc621-9c78-4259-897b-8fd0b0399096 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:50 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f19fc621-9c78-4259-897b-8fd0b0399096 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fe6fed1a5a43e5bd0925b92486ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f984af8c7048c7ba68c1530be9cc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f19fc621-9c78-4259-897b-8fd0b0399096 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617" status: 200 len: 1208 microversion: 2.1 time: 0.093076 Apr 12 03:38:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 157/478] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:50 2023] GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617 => generated 1208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:38:52 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-5918d15b-1472-433c-9165-598ca4a27eae req-200210a6-495e-4a19-b714-4863714cd44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56834002-7593-4592-a86d-23bb90d00be0", "name": "network-vif-deleted", "tag": "8f7b221a-25ae-41f9-847d-5aedf2d93a71"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5918d15b-1472-433c-9165-598ca4a27eae req-200210a6-495e-4a19-b714-4863714cd44b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5918d15b-1472-433c-9165-598ca4a27eae req-200210a6-495e-4a19-b714-4863714cd44b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5918d15b-1472-433c-9165-598ca4a27eae req-200210a6-495e-4a19-b714-4863714cd44b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:52 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5918d15b-1472-433c-9165-598ca4a27eae req-200210a6-495e-4a19-b714-4863714cd44b service nova] Creating event network-vif-deleted:8f7b221a-25ae-41f9-847d-5aedf2d93a71 for instance 56834002-7593-4592-a86d-23bb90d00be0 on user Apr 12 03:38:52 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-5918d15b-1472-433c-9165-598ca4a27eae req-200210a6-495e-4a19-b714-4863714cd44b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037365 Apr 12 03:38:52 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 162/479] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:52 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-0a3f78ba-ef19-4961-985e-a8ba7f7e9c65 req-96270fd5-416c-4ef8-a330-8354d0f19fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56834002-7593-4592-a86d-23bb90d00be0", "name": "network-vif-plugged", "status": "completed", "tag": "8f7b221a-25ae-41f9-847d-5aedf2d93a71"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0a3f78ba-ef19-4961-985e-a8ba7f7e9c65 req-96270fd5-416c-4ef8-a330-8354d0f19fa8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0a3f78ba-ef19-4961-985e-a8ba7f7e9c65 req-96270fd5-416c-4ef8-a330-8354d0f19fa8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0a3f78ba-ef19-4961-985e-a8ba7f7e9c65 req-96270fd5-416c-4ef8-a330-8354d0f19fa8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-0a3f78ba-ef19-4961-985e-a8ba7f7e9c65 req-96270fd5-416c-4ef8-a330-8354d0f19fa8 service nova] Creating event network-vif-plugged:8f7b221a-25ae-41f9-847d-5aedf2d93a71 for instance 56834002-7593-4592-a86d-23bb90d00be0 on user Apr 12 03:38:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-0a3f78ba-ef19-4961-985e-a8ba7f7e9c65 req-96270fd5-416c-4ef8-a330-8354d0f19fa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Apr 12 03:38:52 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 161/480] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9a5b1913-c860-411a-a1f3-5980439beb30 req-1a2e456e-cbad-4d05-9657-ac89a358eb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf03ba16-e423-4042-a8f8-3ca2d0055617", "tag": "f258f181-9892-48fa-b054-aff7b58bd433"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9a5b1913-c860-411a-a1f3-5980439beb30 req-1a2e456e-cbad-4d05-9657-ac89a358eb79 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9a5b1913-c860-411a-a1f3-5980439beb30 req-1a2e456e-cbad-4d05-9657-ac89a358eb79 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9a5b1913-c860-411a-a1f3-5980439beb30 req-1a2e456e-cbad-4d05-9657-ac89a358eb79 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9a5b1913-c860-411a-a1f3-5980439beb30 req-1a2e456e-cbad-4d05-9657-ac89a358eb79 service nova] Creating event network-changed:f258f181-9892-48fa-b054-aff7b58bd433 for instance bf03ba16-e423-4042-a8f8-3ca2d0055617 on user Apr 12 03:38:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9a5b1913-c860-411a-a1f3-5980439beb30 req-1a2e456e-cbad-4d05-9657-ac89a358eb79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031729 Apr 12 03:38:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 158/481] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-feeae2fb-c4da-48e5-be3e-d753a4d99435 req-ba75024d-22b8-4e12-b0df-c86bba30b2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03ba16-e423-4042-a8f8-3ca2d0055617", "name": "network-vif-plugged", "status": "completed", "tag": "f258f181-9892-48fa-b054-aff7b58bd433"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-feeae2fb-c4da-48e5-be3e-d753a4d99435 req-ba75024d-22b8-4e12-b0df-c86bba30b2a1 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-feeae2fb-c4da-48e5-be3e-d753a4d99435 req-ba75024d-22b8-4e12-b0df-c86bba30b2a1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-feeae2fb-c4da-48e5-be3e-d753a4d99435 req-ba75024d-22b8-4e12-b0df-c86bba30b2a1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-feeae2fb-c4da-48e5-be3e-d753a4d99435 req-ba75024d-22b8-4e12-b0df-c86bba30b2a1 service nova] Creating event network-vif-plugged:f258f181-9892-48fa-b054-aff7b58bd433 for instance bf03ba16-e423-4042-a8f8-3ca2d0055617 on user Apr 12 03:38:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-feeae2fb-c4da-48e5-be3e-d753a4d99435 req-ba75024d-22b8-4e12-b0df-c86bba30b2a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Apr 12 03:38:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 163/482] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:55 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f496e5fe694d46a9803f797743a7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cce206e2b94b03ade2d310373c5ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:38:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-69f0a024-c4dd-46d4-a347-36044d66da0e tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7" status: 200 len: 1496 microversion: 2.1 time: 0.205562 Apr 12 03:38:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 162/483] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:38:55 2023] GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7 => generated 1496 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:38:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-60a7ce74-9238-44eb-82b5-4f2ca9a11e82 req-1dd4ef06-b67c-49cf-b6b8-16993d9a48db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03ba16-e423-4042-a8f8-3ca2d0055617", "name": "network-vif-plugged", "status": "completed", "tag": "f258f181-9892-48fa-b054-aff7b58bd433"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:38:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-60a7ce74-9238-44eb-82b5-4f2ca9a11e82 req-1dd4ef06-b67c-49cf-b6b8-16993d9a48db service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:38:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-60a7ce74-9238-44eb-82b5-4f2ca9a11e82 req-1dd4ef06-b67c-49cf-b6b8-16993d9a48db service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:38:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-60a7ce74-9238-44eb-82b5-4f2ca9a11e82 req-1dd4ef06-b67c-49cf-b6b8-16993d9a48db service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:38:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-60a7ce74-9238-44eb-82b5-4f2ca9a11e82 req-1dd4ef06-b67c-49cf-b6b8-16993d9a48db service nova] Creating event network-vif-plugged:f258f181-9892-48fa-b054-aff7b58bd433 for instance bf03ba16-e423-4042-a8f8-3ca2d0055617 on user Apr 12 03:38:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-60a7ce74-9238-44eb-82b5-4f2ca9a11e82 req-1dd4ef06-b67c-49cf-b6b8-16993d9a48db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Apr 12 03:38:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 159/484] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:38:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:02 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:03 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-39fc50bd-c489-4db9-8130-f27e1b8e1fb8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1724 microversion: 2.1 time: 0.418163 Apr 12 03:39:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 164/485] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:02 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=12 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:03 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f1a21992-4c7b-4ea7-9bb2-73b218f5e750 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1724 microversion: 2.1 time: 0.175287 Apr 12 03:39:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 163/486] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:03 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=10 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-db044fba-3b15-4aa8-b185-8a71fc43da93 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054353 Apr 12 03:39:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 160/487] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:39:20 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=5 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] HTTP exception thrown: Instance 23367b24-0a3b-454d-901d-8a3e5396333a is not attached to volume 7e52a442-8ea4-45e3-98eb-dc605d0d1d55 Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Request method failure captured: Apr 12 03:39:21 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments/7e52a442-8ea4-45e3-98eb-dc605d0d1d55 HTTP/1.1 Apr 12 03:39:21 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:39:21 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:39:21 user devstack@n-api.service[62074]: Connection: close Apr 12 03:39:21 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:39:21 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:39:21 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:39:21 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:39:21 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNia2i0SJbnXSsyOiJYY5nvDyeRjF_sl5mAfcPa1VtHIozNVbJZRBZq8JWhH6Zw_bY1Ia6CpLAhVpHPZqzXBnuA6cHQn2g_HAL5bjklnyd4IIZ5Uxmdxd4pf_tbj6hPajirqnXYYJ2tydpw5cnnokaJiE3IkqYCRAfK_kyqqXGDMJb3E Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Project-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/05e1e25933cd42df98fb060b8d2701dc"}]}] Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Tenant: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Tenant-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:39:21 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:39:21 user devstack@n-api.service[62074]: X-User: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:39:21 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:39:21 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:39:21 user devstack@n-api.service[62074]: X-User-Id: 3f8024260bf14d9995e67cb0d1bc8ddc Apr 12 03:39:21 user devstack@n-api.service[62074]: X-User-Name: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:39:21 user devstack@n-api.service[62074]: method: > Apr 12 03:39:21 user devstack@n-api.service[62074]: exception: Instance 23367b24-0a3b-454d-901d-8a3e5396333a is not attached to volume 7e52a442-8ea4-45e3-98eb-dc605d0d1d55 Apr 12 03:39:21 user devstack@n-api.service[62074]: action_args: {'server_id': '23367b24-0a3b-454d-901d-8a3e5396333a', 'id': '7e52a442-8ea4-45e3-98eb-dc605d0d1d55'} Apr 12 03:39:21 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7e52a442-8ea4-45e3-98eb-dc605d0d1d55. Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23367b24-0a3b-454d-901d-8a3e5396333a is not attached to volume 7e52a442-8ea4-45e3-98eb-dc605d0d1d55 Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23367b24-0a3b-454d-901d-8a3e5396333a is not attached to volume 7e52a442-8ea4-45e3-98eb-dc605d0d1d55 Apr 12 03:39:21 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Returning 404 to user: Instance 23367b24-0a3b-454d-901d-8a3e5396333a is not attached to volume 7e52a442-8ea4-45e3-98eb-dc605d0d1d55 {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d30cef57-4fe9-4536-aaad-06f017c35435 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments/7e52a442-8ea4-45e3-98eb-dc605d0d1d55" status: 404 len: 154 microversion: 2.1 time: 0.109463 Apr 12 03:39:21 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 165/488] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:39:21 2023] DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a/os-volume_attachments/7e52a442-8ea4-45e3-98eb-dc605d0d1d55 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=17 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-52c30a78-5c44-4543-8451-613e3b49b479 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.088649 Apr 12 03:39:21 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 164/489] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 03:39:21 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-interface => generated 282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:39:22 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b14db339-b9c0-442f-97a0-22da422821e9 req-3ca21946-32d9-4325-93b5-953e3fdbc22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b14db339-b9c0-442f-97a0-22da422821e9 req-3ca21946-32d9-4325-93b5-953e3fdbc22f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b14db339-b9c0-442f-97a0-22da422821e9 req-3ca21946-32d9-4325-93b5-953e3fdbc22f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b14db339-b9c0-442f-97a0-22da422821e9 req-3ca21946-32d9-4325-93b5-953e3fdbc22f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b14db339-b9c0-442f-97a0-22da422821e9 req-3ca21946-32d9-4325-93b5-953e3fdbc22f service nova] Creating event network-changed:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:39:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b14db339-b9c0-442f-97a0-22da422821e9 req-3ca21946-32d9-4325-93b5-953e3fdbc22f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040076 Apr 12 03:39:22 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 161/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:22 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3999afef-ad9e-41e9-ba68-5efcef77bc3e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/ips" status: 200 len: 109 microversion: 2.20 time: 0.036511 Apr 12 03:39:22 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 166/491] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 03:39:22 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:39:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-0f6bb910-6eab-4356-ac52-fd62b47532e4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 204 len: 0 microversion: 2.1 time: 0.183956 Apr 12 03:39:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 165/492] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:39:23 2023] DELETE /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:23 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f93c5f27-20b3-424d-b668-17d6364dbcb9 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 200 len: 1542 microversion: 2.1 time: 0.320782 Apr 12 03:39:23 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 162/493] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:23 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:24 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lazy-loading 'flavor' on Instance uuid 06481254-722a-4053-a6af-11f5dcc68636 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:24 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7477d878-2133-4fc8-899b-237035a4f110 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 200 len: 1545 microversion: 2.1 time: 0.206103 Apr 12 03:39:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 166/494] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:24 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 1545 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-unplugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}, {"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-plugged", "status": "completed", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] Creating event network-vif-unplugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:39:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] Creating event network-vif-plugged:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:39:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-fee3ccc9-2690-4db2-9991-ff8ed3383720 req-43d65d6d-9406-4619-b386-1448003b80f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036836 Apr 12 03:39:24 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 163/495] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-cfc43321-829f-4bc7-a28f-41c31d44851e tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/action" status: 202 len: 0 microversion: 2.20 time: 1.003973 Apr 12 03:39:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 167/496] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:39:24 2023] POST /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/action => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:25 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-156bf05a-06e5-466b-aad7-139729f31abf req-5d4d16b8-5778-4ff1-970a-d22dd0b249de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23367b24-0a3b-454d-901d-8a3e5396333a", "name": "network-vif-deleted", "tag": "a76c6f07-234b-4832-8ace-ec81656b06a7"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-156bf05a-06e5-466b-aad7-139729f31abf req-5d4d16b8-5778-4ff1-970a-d22dd0b249de service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-156bf05a-06e5-466b-aad7-139729f31abf req-5d4d16b8-5778-4ff1-970a-d22dd0b249de service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-156bf05a-06e5-466b-aad7-139729f31abf req-5d4d16b8-5778-4ff1-970a-d22dd0b249de service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-156bf05a-06e5-466b-aad7-139729f31abf req-5d4d16b8-5778-4ff1-970a-d22dd0b249de service nova] Creating event network-vif-deleted:a76c6f07-234b-4832-8ace-ec81656b06a7 for instance 23367b24-0a3b-454d-901d-8a3e5396333a on user Apr 12 03:39:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-156bf05a-06e5-466b-aad7-139729f31abf req-5d4d16b8-5778-4ff1-970a-d22dd0b249de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049287 Apr 12 03:39:25 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 164/497] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:25 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1bc8a245-81be-4794-89da-77f2c3ac52ee tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1710 microversion: 2.20 time: 0.226391 Apr 12 03:39:25 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 167/498] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:39:25 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1710 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:39:27 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-unplugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}, {"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-plugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] Creating event network-vif-unplugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:39:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] Creating event network-vif-plugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:39:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-b0827922-7004-48b0-8e85-90061c31d719 req-e85644eb-4b31-4b1b-b459-aaf602b54e2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037322 Apr 12 03:39:27 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 168/499] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:27 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-bce74e00-6642-4f96-9b99-cfef13e3b029 req-455425bc-49a0-4814-85f2-f840c2da980f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bce74e00-6642-4f96-9b99-cfef13e3b029 req-455425bc-49a0-4814-85f2-f840c2da980f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bce74e00-6642-4f96-9b99-cfef13e3b029 req-455425bc-49a0-4814-85f2-f840c2da980f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bce74e00-6642-4f96-9b99-cfef13e3b029 req-455425bc-49a0-4814-85f2-f840c2da980f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-bce74e00-6642-4f96-9b99-cfef13e3b029 req-455425bc-49a0-4814-85f2-f840c2da980f service nova] Creating event network-changed:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:39:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-bce74e00-6642-4f96-9b99-cfef13e3b029 req-455425bc-49a0-4814-85f2-f840c2da980f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031545 Apr 12 03:39:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 165/500] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:33 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:33 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:33 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-69330daf-229d-4b3c-9783-d875dad532db tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8" status: 200 len: 1691 microversion: 2.87 time: 0.150275 Apr 12 03:39:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 168/501] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:39:32 2023] GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] [instance: 56834002-7593-4592-a86d-23bb90d00be0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] HTTP exception thrown: Instance 56834002-7593-4592-a86d-23bb90d00be0 could not be found. Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Request method failure captured: Apr 12 03:39:40 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 HTTP/1.1 Apr 12 03:39:40 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:39:40 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:39:40 user devstack@n-api.service[62074]: Connection: close Apr 12 03:39:40 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:39:40 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:39:40 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:39:40 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:39:40 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW-rc7civ_odPK9fyl4-33cQIMenMhNmAY7Y18_9Dd_879WZycL_PiYcvkjCm7KQKY4Vdsybvjmv587cHOpOG6kXI1UAYyznsH8NfV_ceBu-avh0fLQQumXWg4ceJHFVIQKPj4EYHfyWsXUKFjosFwb5_sfx_TmNIO7qcwLEG8kTV4 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Project-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83a7ef3f97fd47849973d4e4482fb5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83a7ef3f97fd47849973d4e4482fb5f9"}]}] Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Tenant: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Tenant-Id: 83a7ef3f97fd47849973d4e4482fb5f9 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServersNegativeTestJSON-864113759 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-User: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:39:40 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:39:40 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:39:40 user devstack@n-api.service[62074]: X-User-Id: 3da7394c51664a7caacfda6b7dda9066 Apr 12 03:39:40 user devstack@n-api.service[62074]: X-User-Name: tempest-ServersNegativeTestJSON-864113759-project-member Apr 12 03:39:40 user devstack@n-api.service[62074]: method: > Apr 12 03:39:40 user devstack@n-api.service[62074]: exception: Instance 56834002-7593-4592-a86d-23bb90d00be0 could not be found. Apr 12 03:39:40 user devstack@n-api.service[62074]: action_args: {'id': '56834002-7593-4592-a86d-23bb90d00be0'} Apr 12 03:39:40 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56834002-7593-4592-a86d-23bb90d00be0 could not be found. Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56834002-7593-4592-a86d-23bb90d00be0 could not be found. Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56834002-7593-4592-a86d-23bb90d00be0 could not be found. Apr 12 03:39:40 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] Returning 404 to user: Instance 56834002-7593-4592-a86d-23bb90d00be0 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ebde5608-6ff0-4324-ad4e-7ec374523821 tempest-ServersNegativeTestJSON-864113759 tempest-ServersNegativeTestJSON-864113759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0" status: 404 len: 111 microversion: 2.1 time: 0.050179 Apr 12 03:39:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 169/502] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:40 2023] GET /compute/v2.1/servers/56834002-7593-4592-a86d-23bb90d00be0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=20 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:40 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fe6fed1a5a43e5bd0925b92486ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f984af8c7048c7ba68c1530be9cc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c98633f4-9d31-4101-85c9-34a1efad8252 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617" status: 200 len: 1486 microversion: 2.1 time: 0.250401 Apr 12 03:39:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 166/503] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:40 2023] GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:43 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a5287591-0d6a-48b6-9a6a-c5de1f0f0ded tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 200 len: 1392 microversion: 2.1 time: 0.154644 Apr 12 03:39:43 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 169/504] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:43 2023] GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1831025023"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:43 user devstack@n-api.service[62074]: INFO nova.compute.api [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Attempting to quiesce instance before volume snapshot. Apr 12 03:39:43 user devstack@n-api.service[62074]: INFO nova.compute.api [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 03:39:43 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Creating snapshot from volume fa33fb38-f437-49cf-b0b6-b5f9e9cbb8cf. {{(pid=62074) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 03:39:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-23f9e826-4955-447c-a38a-8a6daa9902a9 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Action: 'create', calling method: .version_select at 0x7f76a6acad40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1445313134"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-23f9e826-4955-447c-a38a-8a6daa9902a9 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.437804 Apr 12 03:39:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 167/505] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 03:39:44 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 03:39:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-77be7103-5206-4588-9d98-6d294572e8f5 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6bedfc0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:44 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-77be7103-5206-4588-9d98-6d294572e8f5 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 200 len: 345 microversion: 2.1 time: 0.055320 Apr 12 03:39:44 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 170/506] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:39:44 2023] GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6b3bcdf4-db11-4c5f-ac87-bee29a4b9acb tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a696c040>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:45 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6b3bcdf4-db11-4c5f-ac87-bee29a4b9acb tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 200 len: 346 microversion: 2.1 time: 0.054579 Apr 12 03:39:45 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 168/507] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:39:45 2023] GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7e5db911-a4a7-49ef-a0c4-c6683a2df0ef tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Action: 'create', calling method: .version_select at 0x7f76a6aa2dd0>, body: {"snapshot": {"volume_id": "b933236f-a410-4e95-b2aa-60f84cda2e97", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-538055499"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:45 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a0708a3e-f268-43e4-aef1-2dea5ec4e530 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79/action" status: 202 len: 0 microversion: 2.1 time: 2.526888 Apr 12 03:39:45 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 170/508] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:39:43 2023] POST /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79/action => generated 0 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 03:39:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7e5db911-a4a7-49ef-a0c4-c6683a2df0ef tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.149896 Apr 12 03:39:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 171/509] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 03:39:45 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-24c34fb4-0156-4eb5-b8bd-970c98523579 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6b78160>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-24c34fb4-0156-4eb5-b8bd-970c98523579 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 200 len: 286 microversion: 2.1 time: 0.038027 Apr 12 03:39:46 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 169/510] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 03:39:46 2023] GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8e3f73a5-4ab5-4508-b4d3-565613f61b3a tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a69a3be0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-759861809", "imageRef": "1ec76e72-2cb8-4d32-80d6-c41e19d43159", "flavorRef": "42", "networks": [{"uuid": "397a8299-6fbd-4bac-97a1-c8cc31fa2e0e"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8e3f73a5-4ab5-4508-b4d3-565613f61b3a tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040789 Apr 12 03:39:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 171/511] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 03:39:46 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-340312ca-807a-46cf-ae93-223b0c2db623 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6a63eb0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] validate_networks() for [('397a8299-6fbd-4bac-97a1-c8cc31fa2e0e', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:39:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-340312ca-807a-46cf-ae93-223b0c2db623 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 200 len: 286 microversion: 2.1 time: 0.040911 Apr 12 03:39:46 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 170/512] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 03:39:46 2023] GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:39:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='71d39e64-2f0b-4330-a785-fa95db0cc5d1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:39:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b4194d18-7e93-455a-81de-9a4472bd8c61 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.520788 Apr 12 03:39:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 172/513] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:39:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:39:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4f898833-27c0-445b-8107-dfd3894c4a13 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:46 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4f898833-27c0-445b-8107-dfd3894c4a13 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:46 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-4f898833-27c0-445b-8107-dfd3894c4a13 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4f898833-27c0-445b-8107-dfd3894c4a13 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 200 len: 1223 microversion: 2.1 time: 0.078669 Apr 12 03:39:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 172/514] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:46 2023] GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3730225b-4b5e-4070-a8c1-b4f3a001c42a tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6ac95a0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3730225b-4b5e-4070-a8c1-b4f3a001c42a tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 200 len: 287 microversion: 2.1 time: 0.033821 Apr 12 03:39:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 171/515] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 03:39:47 2023] GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:47 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-39300513-1cbb-40a3-af58-5f7a444bdcbd tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6aa2950>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-39300513-1cbb-40a3-af58-5f7a444bdcbd tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 202 len: 0 microversion: 2.1 time: 0.062611 Apr 12 03:39:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 173/516] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 03:39:47 2023] DELETE /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:39:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9c1a9818-ced0-49f6-8554-003edcb9bf63 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a69270a0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9c1a9818-ced0-49f6-8554-003edcb9bf63 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 200 len: 286 microversion: 2.1 time: 0.041535 Apr 12 03:39:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 173/517] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 03:39:47 2023] GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-e6b1270c-2dfc-422d-845c-1ea7dc6b6ea2 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6b79750>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-e6b1270c-2dfc-422d-845c-1ea7dc6b6ea2 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 200 len: 286 microversion: 2.1 time: 0.049142 Apr 12 03:39:48 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 172/518] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 03:39:48 2023] GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e3a10ce0-b3fe-4aee-9b6c-b1cb367db736 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6b8e050>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-e3a10ce0-b3fe-4aee-9b6c-b1cb367db736 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] HTTP exception thrown: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. Apr 12 03:39:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e3a10ce0-b3fe-4aee-9b6c-b1cb367db736 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Request method failure captured: Apr 12 03:39:49 user devstack@n-api.service[62072]: request: GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda HTTP/1.1 Apr 12 03:39:49 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:39:49 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:39:49 user devstack@n-api.service[62072]: Connection: close Apr 12 03:39:49 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:39:49 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:39:49 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:39:49 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:39:49 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNigABzSkHTcZlXknT4aNqsyzuukayhGFd2UySAcfjD9vcl8yOxd-Hc2uQXeecjiWKl4QXPxID8PY3ODOaXaY8b_EbqGsai0UtFgXe0C7Kq8DY1uYr8BSx_t-volYDuZf8BblRhMQYKIjzJa_JloGralLcrhR7cnPUld2S8fnpD7krrE Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Project-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/828bf205b6034febbe30d3e783ed00bc"}]}] Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Tenant-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:49 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:49 user devstack@n-api.service[62072]: X-User: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:49 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:39:49 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:39:49 user devstack@n-api.service[62072]: X-User-Id: da1b2de4b4f64b72b48aff33a07b0978 Apr 12 03:39:49 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:49 user devstack@n-api.service[62072]: method: Apr 12 03:39:49 user devstack@n-api.service[62072]: exception: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. Apr 12 03:39:49 user devstack@n-api.service[62072]: action_args: {'id': 'd6baf2d2-4909-4fb8-83ee-774344e43fda'} Apr 12 03:39:49 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. (HTTP 404) (Request-ID: req-7d36ac13-ec21-42bd-aecb-7d4f9bea76ff) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. Apr 12 03:39:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e3a10ce0-b3fe-4aee-9b6c-b1cb367db736 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Returning 404 to user: Snapshot d6baf2d2-4909-4fb8-83ee-774344e43fda could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e3a10ce0-b3fe-4aee-9b6c-b1cb367db736 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda" status: 404 len: 111 microversion: 2.1 time: 0.035822 Apr 12 03:39:49 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 174/519] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 03:39:49 2023] GET /compute/v2.1/os-snapshots/d6baf2d2-4909-4fb8-83ee-774344e43fda => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9ce28072-e4e7-438a-a56f-15a9842375f5 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a69249d0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:49 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-3f19dc39-328c-40bd-9483-735fcf6da550 req-56ddee45-cba9-4fd1-92d9-74e5e208933c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d211dca2-af04-4dd3-b747-cc3bbd8d310b", "tag": "db8f85d3-266d-4a25-b809-3f4cf95a54d7"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3f19dc39-328c-40bd-9483-735fcf6da550 req-56ddee45-cba9-4fd1-92d9-74e5e208933c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3f19dc39-328c-40bd-9483-735fcf6da550 req-56ddee45-cba9-4fd1-92d9-74e5e208933c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:49 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3f19dc39-328c-40bd-9483-735fcf6da550 req-56ddee45-cba9-4fd1-92d9-74e5e208933c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:49 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-3f19dc39-328c-40bd-9483-735fcf6da550 req-56ddee45-cba9-4fd1-92d9-74e5e208933c service nova] Creating event network-changed:db8f85d3-266d-4a25-b809-3f4cf95a54d7 for instance d211dca2-af04-4dd3-b747-cc3bbd8d310b on user Apr 12 03:39:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9ce28072-e4e7-438a-a56f-15a9842375f5 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 202 len: 0 microversion: 2.1 time: 0.065604 Apr 12 03:39:49 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 174/520] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:39:49 2023] DELETE /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:39:49 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-3f19dc39-328c-40bd-9483-735fcf6da550 req-56ddee45-cba9-4fd1-92d9-74e5e208933c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033467 Apr 12 03:39:49 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 173/521] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f874604c-24fe-49c0-bd7c-bf2aab78c470 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6951fc0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f874604c-24fe-49c0-bd7c-bf2aab78c470 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 200 len: 345 microversion: 2.1 time: 0.051935 Apr 12 03:39:49 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 175/522] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:39:49 2023] GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-412f1ef9-86c9-4ae3-a3c9-db4f1eb861b4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a69a3490>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-412f1ef9-86c9-4ae3-a3c9-db4f1eb861b4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 200 len: 345 microversion: 2.1 time: 0.050979 Apr 12 03:39:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 175/523] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:39:50 2023] GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:39:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-67e80d56-a878-42e6-863b-7c600fa36a19 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6acb400>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-67e80d56-a878-42e6-863b-7c600fa36a19 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] HTTP exception thrown: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-67e80d56-a878-42e6-863b-7c600fa36a19 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Request method failure captured: Apr 12 03:39:51 user devstack@n-api.service[62073]: request: GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 HTTP/1.1 Apr 12 03:39:51 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:39:51 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:39:51 user devstack@n-api.service[62073]: Connection: close Apr 12 03:39:51 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:39:51 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:39:51 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:39:51 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:39:51 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNigABzSkHTcZlXknT4aNqsyzuukayhGFd2UySAcfjD9vcl8yOxd-Hc2uQXeecjiWKl4QXPxID8PY3ODOaXaY8b_EbqGsai0UtFgXe0C7Kq8DY1uYr8BSx_t-volYDuZf8BblRhMQYKIjzJa_JloGralLcrhR7cnPUld2S8fnpD7krrE Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Project-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/828bf205b6034febbe30d3e783ed00bc"}]}] Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Tenant-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:51 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62073]: X-User: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:51 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:39:51 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:39:51 user devstack@n-api.service[62073]: X-User-Id: da1b2de4b4f64b72b48aff33a07b0978 Apr 12 03:39:51 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:51 user devstack@n-api.service[62073]: method: Apr 12 03:39:51 user devstack@n-api.service[62073]: exception: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62073]: action_args: {'id': 'b933236f-a410-4e95-b2aa-60f84cda2e97'} Apr 12 03:39:51 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. (HTTP 404) (Request-ID: req-4e1474f3-266a-425b-9883-bf106e033752) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-67e80d56-a878-42e6-863b-7c600fa36a19 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Returning 404 to user: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-67e80d56-a878-42e6-863b-7c600fa36a19 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 404 len: 109 microversion: 2.1 time: 0.060951 Apr 12 03:39:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 174/524] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:39:51 2023] GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a80616cd-ba97-4ae9-81e3-6fd0094b21ac tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a6951900>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-a80616cd-ba97-4ae9-81e3-6fd0094b21ac tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] HTTP exception thrown: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a80616cd-ba97-4ae9-81e3-6fd0094b21ac tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Request method failure captured: Apr 12 03:39:51 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 HTTP/1.1 Apr 12 03:39:51 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:39:51 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:39:51 user devstack@n-api.service[62072]: Connection: close Apr 12 03:39:51 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:39:51 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:39:51 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:39:51 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:39:51 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNigABzSkHTcZlXknT4aNqsyzuukayhGFd2UySAcfjD9vcl8yOxd-Hc2uQXeecjiWKl4QXPxID8PY3ODOaXaY8b_EbqGsai0UtFgXe0C7Kq8DY1uYr8BSx_t-volYDuZf8BblRhMQYKIjzJa_JloGralLcrhR7cnPUld2S8fnpD7krrE Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Project-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/828bf205b6034febbe30d3e783ed00bc"}]}] Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Tenant-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:51 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62072]: X-User: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:51 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:39:51 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:39:51 user devstack@n-api.service[62072]: X-User-Id: da1b2de4b4f64b72b48aff33a07b0978 Apr 12 03:39:51 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:51 user devstack@n-api.service[62072]: method: Apr 12 03:39:51 user devstack@n-api.service[62072]: exception: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62072]: action_args: {'id': 'b933236f-a410-4e95-b2aa-60f84cda2e97'} Apr 12 03:39:51 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. (HTTP 404) (Request-ID: req-59512c32-7ccd-4a88-b885-c50e352ad80c) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a80616cd-ba97-4ae9-81e3-6fd0094b21ac tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Returning 404 to user: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a80616cd-ba97-4ae9-81e3-6fd0094b21ac tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 404 len: 109 microversion: 2.1 time: 0.049868 Apr 12 03:39:51 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 176/525] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:39:51 2023] DELETE /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9709b827-4b6f-40de-b1e1-30eddd0043f4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Calling method '.version_select at 0x7f76a682a0e0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-9709b827-4b6f-40de-b1e1-30eddd0043f4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] HTTP exception thrown: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9709b827-4b6f-40de-b1e1-30eddd0043f4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Request method failure captured: Apr 12 03:39:51 user devstack@n-api.service[62074]: request: GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 HTTP/1.1 Apr 12 03:39:51 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:39:51 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:39:51 user devstack@n-api.service[62074]: Connection: close Apr 12 03:39:51 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:39:51 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:39:51 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:39:51 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:39:51 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNigABzSkHTcZlXknT4aNqsyzuukayhGFd2UySAcfjD9vcl8yOxd-Hc2uQXeecjiWKl4QXPxID8PY3ODOaXaY8b_EbqGsai0UtFgXe0C7Kq8DY1uYr8BSx_t-volYDuZf8BblRhMQYKIjzJa_JloGralLcrhR7cnPUld2S8fnpD7krrE Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Project-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/828bf205b6034febbe30d3e783ed00bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/828bf205b6034febbe30d3e783ed00bc"}]}] Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Tenant-Id: 828bf205b6034febbe30d3e783ed00bc Apr 12 03:39:51 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222088267 Apr 12 03:39:51 user devstack@n-api.service[62074]: X-User: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:51 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:39:51 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:39:51 user devstack@n-api.service[62074]: X-User-Id: da1b2de4b4f64b72b48aff33a07b0978 Apr 12 03:39:51 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222088267-project-member Apr 12 03:39:51 user devstack@n-api.service[62074]: method: Apr 12 03:39:51 user devstack@n-api.service[62074]: exception: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62074]: action_args: {'id': 'b933236f-a410-4e95-b2aa-60f84cda2e97'} Apr 12 03:39:51 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. (HTTP 404) (Request-ID: req-921701fc-cd1f-4af2-92b2-dae109b5236f) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. Apr 12 03:39:51 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:39:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9709b827-4b6f-40de-b1e1-30eddd0043f4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] Returning 404 to user: Volume b933236f-a410-4e95-b2aa-60f84cda2e97 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9709b827-4b6f-40de-b1e1-30eddd0043f4 tempest-VolumesSnapshotsTestJSON-1222088267 tempest-VolumesSnapshotsTestJSON-1222088267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97" status: 404 len: 109 microversion: 2.1 time: 0.040766 Apr 12 03:39:51 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 176/526] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:39:51 2023] GET /compute/v2.1/os-volumes/b933236f-a410-4e95-b2aa-60f84cda2e97 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9ec65b20-a08a-42ed-a498-41ee41298af6"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] HTTP exception thrown: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Request method failure captured: Apr 12 03:39:57 user devstack@n-api.service[62073]: request: PUT /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7/os-volume_attachments/303edb4b-2ff0-4e7a-b964-af0d28131d18 HTTP/1.1 Apr 12 03:39:57 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:39:57 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:39:57 user devstack@n-api.service[62073]: Connection: close Apr 12 03:39:57 user devstack@n-api.service[62073]: Content-Length: 74 Apr 12 03:39:57 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:39:57 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:39:57 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:39:57 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNibvypmSwHVTIX6j9qyx-TrIPIXXvLkSfT_TOMa9RxBWaNXJ4npnvUBPBCQUa96rGiumv120FoOqIVrQLMVqvp6oB1n8HI1XOvfRUseg_SHO6Nm--zTq_wfBBjn_lKIpUGjFv-edZhViG31rQf1E8T3o-dqEOBzdc3oIhtQ3ZPFgbjY Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Project-Id: 7a0eff14d5f4440fba76d4ac24d7c5e6 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesAdminNegativeTest-419567243 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Role: admin,reader,member Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Roles: admin,reader,member Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a0eff14d5f4440fba76d4ac24d7c5e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a0eff14d5f4440fba76d4ac24d7c5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a0eff14d5f4440fba76d4ac24d7c5e6"}]}] Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesAdminNegativeTest-419567243 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Tenant-Id: 7a0eff14d5f4440fba76d4ac24d7c5e6 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-419567243 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-User: tempest-VolumesAdminNegativeTest-419567243-project-admin Apr 12 03:39:57 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:39:57 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:39:57 user devstack@n-api.service[62073]: X-User-Id: 69cba176942248ba9f3c4ebc017b37c5 Apr 12 03:39:57 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesAdminNegativeTest-419567243-project-admin Apr 12 03:39:57 user devstack@n-api.service[62073]: Apr 12 03:39:57 user devstack@n-api.service[62073]: {"volumeAttachment": {"volumeId": "9ec65b20-a08a-42ed-a498-41ee41298af6"}} Apr 12 03:39:57 user devstack@n-api.service[62073]: method: > Apr 12 03:39:57 user devstack@n-api.service[62073]: exception: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. Apr 12 03:39:57 user devstack@n-api.service[62073]: action_args: {'server_id': 'ff5a7005-6dd4-491a-a55c-db7a82dc28f7', 'id': '303edb4b-2ff0-4e7a-b964-af0d28131d18', 'body': {'volumeAttachment': {'volumeId': '9ec65b20-a08a-42ed-a498-41ee41298af6'}}} Apr 12 03:39:57 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. (HTTP 404) (Request-ID: req-43ac5269-c325-402d-aec3-5edbee4b9dd1) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. Apr 12 03:39:57 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:39:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] Returning 404 to user: Volume 303edb4b-2ff0-4e7a-b964-af0d28131d18 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:39:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-550a1100-dacc-48e6-b7ee-3b11b60ce309 tempest-VolumesAdminNegativeTest-419567243 tempest-VolumesAdminNegativeTest-419567243-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7/os-volume_attachments/303edb4b-2ff0-4e7a-b964-af0d28131d18" status: 404 len: 109 microversion: 2.1 time: 0.133641 Apr 12 03:39:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 175/527] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 03:39:57 2023] PUT /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7/os-volume_attachments/303edb4b-2ff0-4e7a-b964-af0d28131d18 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:39:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-31208b88-a3f2-4775-883d-ef085ef04126 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7" status: 204 len: 0 microversion: 2.1 time: 0.143573 Apr 12 03:39:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 177/528] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:39:59 2023] DELETE /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:39:59 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f496e5fe694d46a9803f797743a7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cce206e2b94b03ade2d310373c5ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:39:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-bd29693e-807c-4ea2-81b6-04ddb65c983b tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7" status: 200 len: 1502 microversion: 2.1 time: 0.211834 Apr 12 03:39:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 177/529] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:39:59 2023] GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:39:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-a77b283b-b583-4537-9456-4b78291cab84 req-b98f3554-e9ab-4953-a67b-3ab3cf5aea71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7005-6dd4-491a-a55c-db7a82dc28f7", "name": "network-vif-unplugged", "status": "completed", "tag": "a460c7a2-ed31-445e-a2a8-296e5163084b"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a77b283b-b583-4537-9456-4b78291cab84 req-b98f3554-e9ab-4953-a67b-3ab3cf5aea71 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a77b283b-b583-4537-9456-4b78291cab84 req-b98f3554-e9ab-4953-a67b-3ab3cf5aea71 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a77b283b-b583-4537-9456-4b78291cab84 req-b98f3554-e9ab-4953-a67b-3ab3cf5aea71 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a77b283b-b583-4537-9456-4b78291cab84 req-b98f3554-e9ab-4953-a67b-3ab3cf5aea71 service nova] Creating event network-vif-unplugged:a460c7a2-ed31-445e-a2a8-296e5163084b for instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 on user Apr 12 03:40:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-a77b283b-b583-4537-9456-4b78291cab84 req-b98f3554-e9ab-4953-a67b-3ab3cf5aea71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057133 Apr 12 03:40:00 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 176/530] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:39:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:40:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-ee775869-eab7-4056-a6e6-0165bae5b289 req-4baf9fe8-6384-49e0-967e-2b15a063c091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7005-6dd4-491a-a55c-db7a82dc28f7", "name": "network-vif-deleted", "tag": "a460c7a2-ed31-445e-a2a8-296e5163084b"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-ee775869-eab7-4056-a6e6-0165bae5b289 req-4baf9fe8-6384-49e0-967e-2b15a063c091 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-ee775869-eab7-4056-a6e6-0165bae5b289 req-4baf9fe8-6384-49e0-967e-2b15a063c091 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-ee775869-eab7-4056-a6e6-0165bae5b289 req-4baf9fe8-6384-49e0-967e-2b15a063c091 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-ee775869-eab7-4056-a6e6-0165bae5b289 req-4baf9fe8-6384-49e0-967e-2b15a063c091 service nova] Creating event network-vif-deleted:a460c7a2-ed31-445e-a2a8-296e5163084b for instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 on user Apr 12 03:40:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-ee775869-eab7-4056-a6e6-0165bae5b289 req-4baf9fe8-6384-49e0-967e-2b15a063c091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057636 Apr 12 03:40:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 178/531] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-0bbd2885-b390-4b67-b995-01d6de6490a7 req-b81d41b6-15fe-4937-940f-d4e40abd23af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211dca2-af04-4dd3-b747-cc3bbd8d310b", "name": "network-vif-plugged", "status": "completed", "tag": "db8f85d3-266d-4a25-b809-3f4cf95a54d7"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0bbd2885-b390-4b67-b995-01d6de6490a7 req-b81d41b6-15fe-4937-940f-d4e40abd23af service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0bbd2885-b390-4b67-b995-01d6de6490a7 req-b81d41b6-15fe-4937-940f-d4e40abd23af service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0bbd2885-b390-4b67-b995-01d6de6490a7 req-b81d41b6-15fe-4937-940f-d4e40abd23af service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-0bbd2885-b390-4b67-b995-01d6de6490a7 req-b81d41b6-15fe-4937-940f-d4e40abd23af service nova] Creating event network-vif-plugged:db8f85d3-266d-4a25-b809-3f4cf95a54d7 for instance d211dca2-af04-4dd3-b747-cc3bbd8d310b on user Apr 12 03:40:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-0bbd2885-b390-4b67-b995-01d6de6490a7 req-b81d41b6-15fe-4937-940f-d4e40abd23af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033213 Apr 12 03:40:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 178/532] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7facc66b-b6e1-45e9-af92-d38c769a5228 req-395dec4b-8abc-4a5b-a46a-3ed82ae2db79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7005-6dd4-491a-a55c-db7a82dc28f7", "name": "network-vif-plugged", "status": "completed", "tag": "a460c7a2-ed31-445e-a2a8-296e5163084b"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7facc66b-b6e1-45e9-af92-d38c769a5228 req-395dec4b-8abc-4a5b-a46a-3ed82ae2db79 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7facc66b-b6e1-45e9-af92-d38c769a5228 req-395dec4b-8abc-4a5b-a46a-3ed82ae2db79 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7facc66b-b6e1-45e9-af92-d38c769a5228 req-395dec4b-8abc-4a5b-a46a-3ed82ae2db79 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7facc66b-b6e1-45e9-af92-d38c769a5228 req-395dec4b-8abc-4a5b-a46a-3ed82ae2db79 service nova] Creating event network-vif-plugged:a460c7a2-ed31-445e-a2a8-296e5163084b for instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 on user Apr 12 03:40:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7facc66b-b6e1-45e9-af92-d38c769a5228 req-395dec4b-8abc-4a5b-a46a-3ed82ae2db79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028425 Apr 12 03:40:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 177/533] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-d8d86a49-07b5-42ed-b6fd-6a7118f31c2a req-e45a53ca-f73d-438a-b1ed-9c72e5201d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211dca2-af04-4dd3-b747-cc3bbd8d310b", "name": "network-vif-plugged", "status": "completed", "tag": "db8f85d3-266d-4a25-b809-3f4cf95a54d7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d8d86a49-07b5-42ed-b6fd-6a7118f31c2a req-e45a53ca-f73d-438a-b1ed-9c72e5201d06 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d8d86a49-07b5-42ed-b6fd-6a7118f31c2a req-e45a53ca-f73d-438a-b1ed-9c72e5201d06 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d8d86a49-07b5-42ed-b6fd-6a7118f31c2a req-e45a53ca-f73d-438a-b1ed-9c72e5201d06 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-d8d86a49-07b5-42ed-b6fd-6a7118f31c2a req-e45a53ca-f73d-438a-b1ed-9c72e5201d06 service nova] Creating event network-vif-plugged:db8f85d3-266d-4a25-b809-3f4cf95a54d7 for instance d211dca2-af04-4dd3-b747-cc3bbd8d310b on user Apr 12 03:40:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-d8d86a49-07b5-42ed-b6fd-6a7118f31c2a req-e45a53ca-f73d-438a-b1ed-9c72e5201d06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Apr 12 03:40:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 179/534] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:03 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lazy-loading 'services' on Instance uuid 48977eb2-ce43-4577-a1cb-340e35703dbd {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:40:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-b0f82ded-cbb4-431a-b301-262db6c1401a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments/0ca0118b-5d36-40b7-bb39-806756144b3a" status: 202 len: 0 microversion: 2.1 time: 0.183965 Apr 12 03:40:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 179/535] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:40:03 2023] DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments/0ca0118b-5d36-40b7-bb39-806756144b3a => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c1364787-1b8a-4e5e-9552-9e368c865c2c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051891 Apr 12 03:40:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 178/536] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:40:03 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 23367b24-0a3b-454d-901d-8a3e5396333a] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] HTTP exception thrown: Instance 23367b24-0a3b-454d-901d-8a3e5396333a could not be found. Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Request method failure captured: Apr 12 03:40:13 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a HTTP/1.1 Apr 12 03:40:13 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:40:13 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:40:13 user devstack@n-api.service[62072]: Connection: close Apr 12 03:40:13 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:40:13 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:40:13 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:40:13 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:40:13 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNia2i0SJbnXSsyOiJYY5nvDyeRjF_sl5mAfcPa1VtHIozNVbJZRBZq8JWhH6Zw_bY1Ia6CpLAhVpHPZqzXBnuA6cHQn2g_HAL5bjklnyd4IIZ5Uxmdxd4pf_tbj6hPajirqnXYYJ2tydpw5cnnokaJiE3IkqYCRAfK_kyqqXGDMJb3E Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Project-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/05e1e25933cd42df98fb060b8d2701dc"}]}] Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Tenant: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Tenant-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:40:13 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:40:13 user devstack@n-api.service[62072]: X-User: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:40:13 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:40:13 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:40:13 user devstack@n-api.service[62072]: X-User-Id: 3f8024260bf14d9995e67cb0d1bc8ddc Apr 12 03:40:13 user devstack@n-api.service[62072]: X-User-Name: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:40:13 user devstack@n-api.service[62072]: method: > Apr 12 03:40:13 user devstack@n-api.service[62072]: exception: Instance 23367b24-0a3b-454d-901d-8a3e5396333a could not be found. Apr 12 03:40:13 user devstack@n-api.service[62072]: action_args: {'id': '23367b24-0a3b-454d-901d-8a3e5396333a'} Apr 12 03:40:13 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23367b24-0a3b-454d-901d-8a3e5396333a could not be found. Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23367b24-0a3b-454d-901d-8a3e5396333a could not be found. Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23367b24-0a3b-454d-901d-8a3e5396333a could not be found. Apr 12 03:40:13 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Returning 404 to user: Instance 23367b24-0a3b-454d-901d-8a3e5396333a could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:40:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d56a2e5d-e2a0-4303-ba30-d0f642a43bae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a" status: 404 len: 111 microversion: 2.1 time: 0.035371 Apr 12 03:40:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 180/537] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:13 2023] GET /compute/v2.1/servers/23367b24-0a3b-454d-901d-8a3e5396333a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:40:13 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:13 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8ecd98b1-5736-4997-819f-7be8858058ae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '.version_select at 0x7f76a682bac0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8ecd98b1-5736-4997-819f-7be8858058ae tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2058975683" status: 202 len: 0 microversion: 2.1 time: 0.034775 Apr 12 03:40:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 180/538] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 03:40:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2058975683 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=22 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:15 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6019e731-b257-4958-bf72-36a3bb2c2f67 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1651 microversion: 2.20 time: 0.354282 Apr 12 03:40:15 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 179/539] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:40:15 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1651 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:40:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3bbd410b-b85f-46d6-abea-1fdea89bda03 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'create', calling method: .version_select at 0x7f76a6953400>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1199406481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPcbdFPNwSacXUiuG3oK16SVNbJsO/MbG4r56gwQ5WdhiWutK0MgzDXL9ED179Ry++/GuDPfwLne43xpH8kd84JNZdPdBD50aHcS2/YXE5ZEXdAfa8QEldhEXCO3fgFsQ=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:16 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-3bbd410b-b85f-46d6-abea-1fdea89bda03 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:40:16 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-3bbd410b-b85f-46d6-abea-1fdea89bda03 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for user 3f8024260bf14d9995e67cb0d1bc8ddc and project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:40:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-3bbd410b-b85f-46d6-abea-1fdea89bda03 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044796 Apr 12 03:40:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 181/540] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:40:16 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:16 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-470315255", "imageRef": "e198a023-7244-4f4f-b524-67b3b8abbd94", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1199406481", "networks": [{"uuid": "91a7501a-44a5-4d48-a1f7-e1195ac99607"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] validate_networks() for [('91a7501a-44a5-4d48-a1f7-e1195ac99607', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Getting quotas for user 3f8024260bf14d9995e67cb0d1bc8ddc and project 05e1e25933cd42df98fb060b8d2701dc. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:40:17 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e198a023-7244-4f4f-b524-67b3b8abbd94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:40:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-7d6d4fac-cdad-4d55-baf1-0de0081073d8 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.911253 Apr 12 03:40:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 181/541] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:40:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:40:17 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f7d37169-58eb-435e-a956-0a6ebb2282cc tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:17 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f7d37169-58eb-435e-a956-0a6ebb2282cc tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:17 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f7d37169-58eb-435e-a956-0a6ebb2282cc tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f7d37169-58eb-435e-a956-0a6ebb2282cc tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1252 microversion: 2.1 time: 0.067820 Apr 12 03:40:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 180/542] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:17 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1252 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b9aa54d0-4f61-42c3-953a-3f26bfecb8a5 req-b4bdb9e2-d24a-4bd6-ba6f-b7c6cfc34617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b9aa54d0-4f61-42c3-953a-3f26bfecb8a5 req-b4bdb9e2-d24a-4bd6-ba6f-b7c6cfc34617 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b9aa54d0-4f61-42c3-953a-3f26bfecb8a5 req-b4bdb9e2-d24a-4bd6-ba6f-b7c6cfc34617 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b9aa54d0-4f61-42c3-953a-3f26bfecb8a5 req-b4bdb9e2-d24a-4bd6-ba6f-b7c6cfc34617 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b9aa54d0-4f61-42c3-953a-3f26bfecb8a5 req-b4bdb9e2-d24a-4bd6-ba6f-b7c6cfc34617 service nova] Creating event network-changed:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:40:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b9aa54d0-4f61-42c3-953a-3f26bfecb8a5 req-b4bdb9e2-d24a-4bd6-ba6f-b7c6cfc34617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028119 Apr 12 03:40:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 182/543] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:23 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-290d2102-3226-481f-8c9b-dd9aa4be3b2c req-04b0a7c6-7ed7-4970-9949-76038fa2d515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-plugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-290d2102-3226-481f-8c9b-dd9aa4be3b2c req-04b0a7c6-7ed7-4970-9949-76038fa2d515 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-290d2102-3226-481f-8c9b-dd9aa4be3b2c req-04b0a7c6-7ed7-4970-9949-76038fa2d515 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-290d2102-3226-481f-8c9b-dd9aa4be3b2c req-04b0a7c6-7ed7-4970-9949-76038fa2d515 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-290d2102-3226-481f-8c9b-dd9aa4be3b2c req-04b0a7c6-7ed7-4970-9949-76038fa2d515 service nova] Creating event network-vif-plugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:40:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-290d2102-3226-481f-8c9b-dd9aa4be3b2c req-04b0a7c6-7ed7-4970-9949-76038fa2d515 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221711 Apr 12 03:40:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 182/544] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3ee64311-ff23-4291-b5c1-5408a512f83e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.126164 Apr 12 03:40:24 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 181/545] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:40:24 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-interface => generated 282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-4bbbcd52-c86e-471b-b3d0-ef29d3f35e5a req-b52887e8-6341-40ef-9b9a-fb3bfa42e12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-plugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4bbbcd52-c86e-471b-b3d0-ef29d3f35e5a req-b52887e8-6341-40ef-9b9a-fb3bfa42e12b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4bbbcd52-c86e-471b-b3d0-ef29d3f35e5a req-b52887e8-6341-40ef-9b9a-fb3bfa42e12b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4bbbcd52-c86e-471b-b3d0-ef29d3f35e5a req-b52887e8-6341-40ef-9b9a-fb3bfa42e12b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4bbbcd52-c86e-471b-b3d0-ef29d3f35e5a req-b52887e8-6341-40ef-9b9a-fb3bfa42e12b service nova] Creating event network-vif-plugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:40:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-4bbbcd52-c86e-471b-b3d0-ef29d3f35e5a req-b52887e8-6341-40ef-9b9a-fb3bfa42e12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040968 Apr 12 03:40:25 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 183/546] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-1291bdc6-5bac-4595-9391-3bfa8aab6ee0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/ips" status: 200 len: 108 microversion: 2.1 time: 0.040302 Apr 12 03:40:25 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 182/547] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:40:25 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:25 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1a66206a-9b2e-4b1e-93a2-350e2e2eadf1 req-f6a1a480-e34d-4ad1-88f1-e8ffd5799229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a66206a-9b2e-4b1e-93a2-350e2e2eadf1 req-f6a1a480-e34d-4ad1-88f1-e8ffd5799229 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a66206a-9b2e-4b1e-93a2-350e2e2eadf1 req-f6a1a480-e34d-4ad1-88f1-e8ffd5799229 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a66206a-9b2e-4b1e-93a2-350e2e2eadf1 req-f6a1a480-e34d-4ad1-88f1-e8ffd5799229 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1a66206a-9b2e-4b1e-93a2-350e2e2eadf1 req-f6a1a480-e34d-4ad1-88f1-e8ffd5799229 service nova] Creating event network-changed:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:40:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1a66206a-9b2e-4b1e-93a2-350e2e2eadf1 req-f6a1a480-e34d-4ad1-88f1-e8ffd5799229 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226256 Apr 12 03:40:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 183/548] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "492e66f2-98d6-43d6-bbe6-cbe61f9335f6"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-64e003c7-95b9-46e3-912b-cffbafff7111 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513144 Apr 12 03:40:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 184/549] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:40:27 2023] POST /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1577634925"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:34 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0d519d7a-4c9d-4493-884a-c37bc42b99f8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8/action" status: 202 len: 52 microversion: 2.87 time: 1.020900 Apr 12 03:40:34 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 183/550] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:40:33 2023] POST /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8/action => generated 52 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 03:40:35 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:35 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-0e7a7b64-73fc-46bc-9138-a7b339ff136c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: .version_select at 0x7f76a69241f0>, body: {"keypair": {"name": "tempest-keypair-819201420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyKNKT4wgJznr+Ex2kNQaN9dpRqnWsyzDU9MRy0fmokHPPmcvE5+ezeiXGgA2zAoziwbaT10GVLc8cJoTbEoKhsJqM+5rbndvelFILpQi0tIFZnPn0XCK6f6SU5ZH8k7g=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:35 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-0e7a7b64-73fc-46bc-9138-a7b339ff136c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:40:35 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-0e7a7b64-73fc-46bc-9138-a7b339ff136c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:40:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-0e7a7b64-73fc-46bc-9138-a7b339ff136c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062043 Apr 12 03:40:35 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 184/551] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:40:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:37 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4c427c9d-b5b0-4745-be14-de71daba4be8 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 200 len: 1549 microversion: 2.1 time: 0.414518 Apr 12 03:40:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 185/552] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:36 2023] GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 1549 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1563626038", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ddbce990-4cfa-40bd-b1e1-fc1531789074"}], "security_groups": [{"name": "tempest-securitygroup--623302729"}], "key_name": "tempest-keypair-819201420", "user_data": "}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:37 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] validate_networks() for [('ddbce990-4cfa-40bd-b1e1-fc1531789074', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:40:38 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:40:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f0683b23-5834-4ba3-8f20-34a5cfca0c5d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.668772 Apr 12 03:40:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 184/553] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:40:37 2023] POST /compute/v2.1/servers => generated 399 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:40:38 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:38 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2ddf78e2-e488-4dd1-8fb1-467e0ee92781 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:38 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2ddf78e2-e488-4dd1-8fb1-467e0ee92781 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:38 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-2ddf78e2-e488-4dd1-8fb1-467e0ee92781 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2ddf78e2-e488-4dd1-8fb1-467e0ee92781 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 200 len: 1235 microversion: 2.1 time: 0.132134 Apr 12 03:40:38 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 185/554] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:38 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 1235 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:40 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d76d0f82-038f-4332-8d07-e3b2f1c482d8 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8" status: 200 len: 1691 microversion: 2.87 time: 0.211676 Apr 12 03:40:40 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 186/555] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:40:40 2023] GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d910653b-2432-4848-a5b1-55b1a74025e6 req-e358838f-2a49-461f-8c1b-338321c5d2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d910653b-2432-4848-a5b1-55b1a74025e6 req-e358838f-2a49-461f-8c1b-338321c5d2a7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d910653b-2432-4848-a5b1-55b1a74025e6 req-e358838f-2a49-461f-8c1b-338321c5d2a7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d910653b-2432-4848-a5b1-55b1a74025e6 req-e358838f-2a49-461f-8c1b-338321c5d2a7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d910653b-2432-4848-a5b1-55b1a74025e6 req-e358838f-2a49-461f-8c1b-338321c5d2a7 service nova] Creating event network-changed:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:40:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d910653b-2432-4848-a5b1-55b1a74025e6 req-e358838f-2a49-461f-8c1b-338321c5d2a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034842 Apr 12 03:40:41 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 185/556] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:41 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:40:41 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-75304fcb-33a8-4519-930e-42178f6db253 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617" status: 204 len: 0 microversion: 2.1 time: 0.268893 Apr 12 03:40:41 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 186/557] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:40:41 2023] DELETE /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:41 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fe6fed1a5a43e5bd0925b92486ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f984af8c7048c7ba68c1530be9cc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9183bf23-8c0f-46a4-b726-d9978efcedf7 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617" status: 200 len: 1492 microversion: 2.1 time: 0.219874 Apr 12 03:40:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 187/558] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:41 2023] GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617 => generated 1492 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-3f965ce2-73e9-4011-b2c9-f2e6b699b8ab req-c504e01c-462d-4e67-a7e0-97c66fdab005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03ba16-e423-4042-a8f8-3ca2d0055617", "name": "network-vif-unplugged", "status": "completed", "tag": "f258f181-9892-48fa-b054-aff7b58bd433"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3f965ce2-73e9-4011-b2c9-f2e6b699b8ab req-c504e01c-462d-4e67-a7e0-97c66fdab005 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3f965ce2-73e9-4011-b2c9-f2e6b699b8ab req-c504e01c-462d-4e67-a7e0-97c66fdab005 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3f965ce2-73e9-4011-b2c9-f2e6b699b8ab req-c504e01c-462d-4e67-a7e0-97c66fdab005 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-3f965ce2-73e9-4011-b2c9-f2e6b699b8ab req-c504e01c-462d-4e67-a7e0-97c66fdab005 service nova] Creating event network-vif-unplugged:f258f181-9892-48fa-b054-aff7b58bd433 for instance bf03ba16-e423-4042-a8f8-3ca2d0055617 on user Apr 12 03:40:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-3f965ce2-73e9-4011-b2c9-f2e6b699b8ab req-c504e01c-462d-4e67-a7e0-97c66fdab005 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036827 Apr 12 03:40:41 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 186/559] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:43 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-7b846477-cd85-4cce-8c4c-734b13b07e15 req-8298a23a-f949-4d95-9eed-b0d4cc6654c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03ba16-e423-4042-a8f8-3ca2d0055617", "name": "network-vif-deleted", "tag": "f258f181-9892-48fa-b054-aff7b58bd433"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7b846477-cd85-4cce-8c4c-734b13b07e15 req-8298a23a-f949-4d95-9eed-b0d4cc6654c9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7b846477-cd85-4cce-8c4c-734b13b07e15 req-8298a23a-f949-4d95-9eed-b0d4cc6654c9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:43 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7b846477-cd85-4cce-8c4c-734b13b07e15 req-8298a23a-f949-4d95-9eed-b0d4cc6654c9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:43 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-7b846477-cd85-4cce-8c4c-734b13b07e15 req-8298a23a-f949-4d95-9eed-b0d4cc6654c9 service nova] Creating event network-vif-deleted:f258f181-9892-48fa-b054-aff7b58bd433 for instance bf03ba16-e423-4042-a8f8-3ca2d0055617 on user Apr 12 03:40:43 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-7b846477-cd85-4cce-8c4c-734b13b07e15 req-8298a23a-f949-4d95-9eed-b0d4cc6654c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062182 Apr 12 03:40:43 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 187/560] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:43 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-61a8b8a1-c51b-4a8a-835b-a4ff8ce4ae89 req-89ecf3b0-a0a4-4020-8b7e-09689e686869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03ba16-e423-4042-a8f8-3ca2d0055617", "name": "network-vif-plugged", "status": "completed", "tag": "f258f181-9892-48fa-b054-aff7b58bd433"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-61a8b8a1-c51b-4a8a-835b-a4ff8ce4ae89 req-89ecf3b0-a0a4-4020-8b7e-09689e686869 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-61a8b8a1-c51b-4a8a-835b-a4ff8ce4ae89 req-89ecf3b0-a0a4-4020-8b7e-09689e686869 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-61a8b8a1-c51b-4a8a-835b-a4ff8ce4ae89 req-89ecf3b0-a0a4-4020-8b7e-09689e686869 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-61a8b8a1-c51b-4a8a-835b-a4ff8ce4ae89 req-89ecf3b0-a0a4-4020-8b7e-09689e686869 service nova] Creating event network-vif-plugged:f258f181-9892-48fa-b054-aff7b58bd433 for instance bf03ba16-e423-4042-a8f8-3ca2d0055617 on user Apr 12 03:40:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-61a8b8a1-c51b-4a8a-835b-a4ff8ce4ae89 req-89ecf3b0-a0a4-4020-8b7e-09689e686869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034800 Apr 12 03:40:43 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 188/561] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:43 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-e8866a42-66b5-4f6e-978b-8d321e32ee96 req-8ce3084f-94b0-4426-8508-0d62c32d5e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "name": "network-vif-plugged", "status": "completed", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e8866a42-66b5-4f6e-978b-8d321e32ee96 req-8ce3084f-94b0-4426-8508-0d62c32d5e78 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e8866a42-66b5-4f6e-978b-8d321e32ee96 req-8ce3084f-94b0-4426-8508-0d62c32d5e78 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:43 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e8866a42-66b5-4f6e-978b-8d321e32ee96 req-8ce3084f-94b0-4426-8508-0d62c32d5e78 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:43 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e8866a42-66b5-4f6e-978b-8d321e32ee96 req-8ce3084f-94b0-4426-8508-0d62c32d5e78 service nova] Creating event network-vif-plugged:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:40:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-e8866a42-66b5-4f6e-978b-8d321e32ee96 req-8ce3084f-94b0-4426-8508-0d62c32d5e78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034479 Apr 12 03:40:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 187/562] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-abf830d9-163a-481a-b461-99a23151cd72 req-5feadf49-67af-4965-86e5-759ba1a09c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "name": "network-vif-plugged", "status": "completed", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:46 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-abf830d9-163a-481a-b461-99a23151cd72 req-5feadf49-67af-4965-86e5-759ba1a09c28 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-abf830d9-163a-481a-b461-99a23151cd72 req-5feadf49-67af-4965-86e5-759ba1a09c28 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-abf830d9-163a-481a-b461-99a23151cd72 req-5feadf49-67af-4965-86e5-759ba1a09c28 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-abf830d9-163a-481a-b461-99a23151cd72 req-5feadf49-67af-4965-86e5-759ba1a09c28 service nova] Creating event network-vif-plugged:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:40:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-abf830d9-163a-481a-b461-99a23151cd72 req-5feadf49-67af-4965-86e5-759ba1a09c28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048396 Apr 12 03:40:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 188/563] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: ff5a7005-6dd4-491a-a55c-db7a82dc28f7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] HTTP exception thrown: Instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 could not be found. Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Request method failure captured: Apr 12 03:40:50 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7 HTTP/1.1 Apr 12 03:40:50 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:40:50 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:40:50 user devstack@n-api.service[62072]: Connection: close Apr 12 03:40:50 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:40:50 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:40:50 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:40:50 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:40:50 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNibn9epN0mfwnKT-VX18PrxsMFHZa41bjt-fcBEsi4_dhzp0ESjAhXT8BgQ30UnVHjLZla6UzSIWAE7ai68FjLMYW3qVzXMcKXibLe0bYhdMjUh97ZWYfcpFJOCQJ4PFsq1Ksskm2eq5i2co7LFLimjLi3RX1L_6X58lH0kphU4O5-c Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Project-Id: f4cce206e2b94b03ade2d310373c5ca2 Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesAdminNegativeTest-2105871059 Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4cce206e2b94b03ade2d310373c5ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4cce206e2b94b03ade2d310373c5ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4cce206e2b94b03ade2d310373c5ca2"}]}] Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesAdminNegativeTest-2105871059 Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Tenant-Id: f4cce206e2b94b03ade2d310373c5ca2 Apr 12 03:40:50 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2105871059 Apr 12 03:40:50 user devstack@n-api.service[62072]: X-User: tempest-VolumesAdminNegativeTest-2105871059-project-member Apr 12 03:40:50 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:40:50 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:40:50 user devstack@n-api.service[62072]: X-User-Id: e2f496e5fe694d46a9803f797743a7dc Apr 12 03:40:50 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesAdminNegativeTest-2105871059-project-member Apr 12 03:40:50 user devstack@n-api.service[62072]: method: > Apr 12 03:40:50 user devstack@n-api.service[62072]: exception: Instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 could not be found. Apr 12 03:40:50 user devstack@n-api.service[62072]: action_args: {'id': 'ff5a7005-6dd4-491a-a55c-db7a82dc28f7'} Apr 12 03:40:50 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 could not be found. Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 could not be found. Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 could not be found. Apr 12 03:40:50 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:40:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Returning 404 to user: Instance ff5a7005-6dd4-491a-a55c-db7a82dc28f7 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:40:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-10a3d248-47dc-4126-9a9e-4d08dfea8a3f tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7" status: 404 len: 111 microversion: 2.1 time: 0.211665 Apr 12 03:40:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 189/564] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:49 2023] GET /compute/v2.1/servers/ff5a7005-6dd4-491a-a55c-db7a82dc28f7 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:52 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:40:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6641096e-8d16-449e-a5c3-9ec019acfb82 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6" status: 204 len: 0 microversion: 2.1 time: 0.130943 Apr 12 03:40:52 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 188/565] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:40:52 2023] DELETE /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:52 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f496e5fe694d46a9803f797743a7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4cce206e2b94b03ade2d310373c5ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:52 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-57281785-f679-46a8-a618-8d6a2fd61b1c tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6" status: 200 len: 1669 microversion: 2.1 time: 0.284945 Apr 12 03:40:52 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 189/566] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:52 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:52 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-888204f5-4d82-4d5c-a0ba-32dc29db4824 req-65709e61-9b6d-45ca-ae3e-44007e6ce170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "name": "network-vif-unplugged", "status": "completed", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-888204f5-4d82-4d5c-a0ba-32dc29db4824 req-65709e61-9b6d-45ca-ae3e-44007e6ce170 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-888204f5-4d82-4d5c-a0ba-32dc29db4824 req-65709e61-9b6d-45ca-ae3e-44007e6ce170 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-888204f5-4d82-4d5c-a0ba-32dc29db4824 req-65709e61-9b6d-45ca-ae3e-44007e6ce170 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-888204f5-4d82-4d5c-a0ba-32dc29db4824 req-65709e61-9b6d-45ca-ae3e-44007e6ce170 service nova] Creating event network-vif-unplugged:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:40:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-888204f5-4d82-4d5c-a0ba-32dc29db4824 req-65709e61-9b6d-45ca-ae3e-44007e6ce170 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043853 Apr 12 03:40:52 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 190/567] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-80e2a7f1-9b11-46a4-9001-3762967f0ba9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056985 Apr 12 03:40:53 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 189/568] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:40:53 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-83e43945-facb-466d-9cde-a81b590669ff req-1567a42f-37fd-4c2c-9763-ff4497b78f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "name": "network-vif-deleted", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-83e43945-facb-466d-9cde-a81b590669ff req-1567a42f-37fd-4c2c-9763-ff4497b78f8d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-83e43945-facb-466d-9cde-a81b590669ff req-1567a42f-37fd-4c2c-9763-ff4497b78f8d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-83e43945-facb-466d-9cde-a81b590669ff req-1567a42f-37fd-4c2c-9763-ff4497b78f8d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-0477e173-5e33-4003-a99c-16952e591c4e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1678 microversion: 2.1 time: 0.173214 Apr 12 03:40:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 190/569] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:54 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-83e43945-facb-466d-9cde-a81b590669ff req-1567a42f-37fd-4c2c-9763-ff4497b78f8d service nova] Creating event network-vif-deleted:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:40:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-83e43945-facb-466d-9cde-a81b590669ff req-1567a42f-37fd-4c2c-9763-ff4497b78f8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038080 Apr 12 03:40:54 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 191/570] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cb0d4558-025b-4855-8647-61c552a92835 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1678 microversion: 2.1 time: 0.269570 Apr 12 03:40:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 190/571] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:54 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:40:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-b5ca7000-07b8-4b5e-b032-2a988d7e91e9 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1678 microversion: 2.1 time: 0.164856 Apr 12 03:40:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 191/572] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:40:54 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-646c36a6-960f-4adc-b189-49f6f99b0144 req-91826a65-81b8-4d6b-8f07-5ebbfb968e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6", "name": "network-vif-plugged", "status": "completed", "tag": "892ff129-c9ca-4295-be61-993b81b855fb"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-646c36a6-960f-4adc-b189-49f6f99b0144 req-91826a65-81b8-4d6b-8f07-5ebbfb968e6a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-646c36a6-960f-4adc-b189-49f6f99b0144 req-91826a65-81b8-4d6b-8f07-5ebbfb968e6a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:40:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-646c36a6-960f-4adc-b189-49f6f99b0144 req-91826a65-81b8-4d6b-8f07-5ebbfb968e6a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:40:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-646c36a6-960f-4adc-b189-49f6f99b0144 req-91826a65-81b8-4d6b-8f07-5ebbfb968e6a service nova] Creating event network-vif-plugged:892ff129-c9ca-4295-be61-993b81b855fb for instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 on user Apr 12 03:40:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-646c36a6-960f-4adc-b189-49f6f99b0144 req-91826a65-81b8-4d6b-8f07-5ebbfb968e6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Apr 12 03:40:54 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 192/573] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:40:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:07 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b0c6d114-8c82-4c55-badf-7c74bb23f50d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1535 microversion: 2.1 time: 0.165165 Apr 12 03:41:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 191/574] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:07 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1535 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:41:15 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=7 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:15 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63287daa-2fc1-4ffe-b31c-b8c29a605592"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:16 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2034b89e-b759-489b-8b1c-9bcecf49b9ed tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.535079 Apr 12 03:41:16 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 192/575] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 03:41:15 2023] POST /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-volume_attachments => generated 188 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=7 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=7 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ed3fd089-13c0-422e-a741-bb3b59089e3f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-volume_attachments/63287daa-2fc1-4ffe-b31c-b8c29a605592" status: 202 len: 0 microversion: 2.20 time: 0.244523 Apr 12 03:41:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 193/576] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 03:41:16 2023] DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-volume_attachments/63287daa-2fc1-4ffe-b31c-b8c29a605592 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:16 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62073) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 03:41:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-384b09cc-37df-4279-9da7-c7db26a21ded tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/action" status: 202 len: 0 microversion: 2.20 time: 0.110760 Apr 12 03:41:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 192/577] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:41:16 2023] POST /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:17 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-29f2e6f3-9c8b-4204-8191-c314f9809265 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1659 microversion: 2.20 time: 0.156075 Apr 12 03:41:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 193/578] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:41:17 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1659 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:41:19 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b8a7aa5b-a8fc-45f1-90f1-574e7bd16241 req-7a88be42-e5bb-46f8-a669-662a0e0bf324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b8a7aa5b-a8fc-45f1-90f1-574e7bd16241 req-7a88be42-e5bb-46f8-a669-662a0e0bf324 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b8a7aa5b-a8fc-45f1-90f1-574e7bd16241 req-7a88be42-e5bb-46f8-a669-662a0e0bf324 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b8a7aa5b-a8fc-45f1-90f1-574e7bd16241 req-7a88be42-e5bb-46f8-a669-662a0e0bf324 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:19 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b8a7aa5b-a8fc-45f1-90f1-574e7bd16241 req-7a88be42-e5bb-46f8-a669-662a0e0bf324 service nova] Creating event network-changed:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:41:19 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b8a7aa5b-a8fc-45f1-90f1-574e7bd16241 req-7a88be42-e5bb-46f8-a669-662a0e0bf324 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031719 Apr 12 03:41:19 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 194/579] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1d671a8c-8e05-4d95-b9bc-50d08a636c4f req-e6bd2bfa-338e-4ec3-98ba-ca6c0710eb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-plugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1d671a8c-8e05-4d95-b9bc-50d08a636c4f req-e6bd2bfa-338e-4ec3-98ba-ca6c0710eb1a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1d671a8c-8e05-4d95-b9bc-50d08a636c4f req-e6bd2bfa-338e-4ec3-98ba-ca6c0710eb1a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1d671a8c-8e05-4d95-b9bc-50d08a636c4f req-e6bd2bfa-338e-4ec3-98ba-ca6c0710eb1a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1d671a8c-8e05-4d95-b9bc-50d08a636c4f req-e6bd2bfa-338e-4ec3-98ba-ca6c0710eb1a service nova] Creating event network-vif-plugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:41:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1d671a8c-8e05-4d95-b9bc-50d08a636c4f req-e6bd2bfa-338e-4ec3-98ba-ca6c0710eb1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Apr 12 03:41:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 193/580] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-bf1e65c6-6e8d-4407-9cdd-eedb4ae755a9 req-cab67a73-bf82-4cd0-897d-13152ad7b6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-plugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:28 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:28 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bf1e65c6-6e8d-4407-9cdd-eedb4ae755a9 req-cab67a73-bf82-4cd0-897d-13152ad7b6ed service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bf1e65c6-6e8d-4407-9cdd-eedb4ae755a9 req-cab67a73-bf82-4cd0-897d-13152ad7b6ed service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bf1e65c6-6e8d-4407-9cdd-eedb4ae755a9 req-cab67a73-bf82-4cd0-897d-13152ad7b6ed service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-bf1e65c6-6e8d-4407-9cdd-eedb4ae755a9 req-cab67a73-bf82-4cd0-897d-13152ad7b6ed service nova] Creating event network-vif-plugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:41:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-bf1e65c6-6e8d-4407-9cdd-eedb4ae755a9 req-cab67a73-bf82-4cd0-897d-13152ad7b6ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041611 Apr 12 03:41:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 194/581] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:28 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-33b9bf8b-dfec-4989-b811-ce87e3981629 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 200 len: 1544 microversion: 2.1 time: 0.146793 Apr 12 03:41:28 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 195/582] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:28 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 1544 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: bf03ba16-e423-4042-a8f8-3ca2d0055617] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] HTTP exception thrown: Instance bf03ba16-e423-4042-a8f8-3ca2d0055617 could not be found. Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Request method failure captured: Apr 12 03:41:31 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617 HTTP/1.1 Apr 12 03:41:31 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:41:31 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:41:31 user devstack@n-api.service[62073]: Connection: close Apr 12 03:41:31 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:41:31 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:41:31 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:41:31 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:41:31 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNifIySFbf0Mt0gMi-BdCsqxxnEphfgi-v7jCZIJejHEKov6SyYjWVDJxzbHZW6pY70A_W_e7sR3OQIQemGYC9VPO8ZLyqID6cRJzvRd327Zm3L35hL138JZKuaN8cpxKS_yE7dc5_A4bgeiEZNueobQ6J5RijAJYz_bXrQhNCmQCaWo Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Project-Id: f4f984af8c7048c7ba68c1530be9cc8d Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesActionsTest-629816748 Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4f984af8c7048c7ba68c1530be9cc8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4f984af8c7048c7ba68c1530be9cc8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4f984af8c7048c7ba68c1530be9cc8d"}]}] Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesActionsTest-629816748 Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Tenant-Id: f4f984af8c7048c7ba68c1530be9cc8d Apr 12 03:41:31 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesActionsTest-629816748 Apr 12 03:41:31 user devstack@n-api.service[62073]: X-User: tempest-VolumesActionsTest-629816748-project-member Apr 12 03:41:31 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:41:31 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:41:31 user devstack@n-api.service[62073]: X-User-Id: 45fe6fed1a5a43e5bd0925b92486ec68 Apr 12 03:41:31 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesActionsTest-629816748-project-member Apr 12 03:41:31 user devstack@n-api.service[62073]: method: > Apr 12 03:41:31 user devstack@n-api.service[62073]: exception: Instance bf03ba16-e423-4042-a8f8-3ca2d0055617 could not be found. Apr 12 03:41:31 user devstack@n-api.service[62073]: action_args: {'id': 'bf03ba16-e423-4042-a8f8-3ca2d0055617'} Apr 12 03:41:31 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf03ba16-e423-4042-a8f8-3ca2d0055617 could not be found. Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf03ba16-e423-4042-a8f8-3ca2d0055617 could not be found. Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf03ba16-e423-4042-a8f8-3ca2d0055617 could not be found. Apr 12 03:41:31 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:41:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Returning 404 to user: Instance bf03ba16-e423-4042-a8f8-3ca2d0055617 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:41:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-78f4628e-0f33-444e-adf4-0d2ee327f5b0 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617" status: 404 len: 111 microversion: 2.1 time: 0.031304 Apr 12 03:41:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 194/583] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:31 2023] GET /compute/v2.1/servers/bf03ba16-e423-4042-a8f8-3ca2d0055617 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1538366054", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "3ec59075-3409-4372-a0ca-6283a5d56ca0"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] validate_networks() for [('3ec59075-3409-4372-a0ca-6283a5d56ca0', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Getting quotas for project f4f984af8c7048c7ba68c1530be9cc8d. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Getting quotas for user 45fe6fed1a5a43e5bd0925b92486ec68 and project f4f984af8c7048c7ba68c1530be9cc8d. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:41:32 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:41:32 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8340c1df-e680-4314-bf5b-96d5d23b3712 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.500346 Apr 12 03:41:32 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 195/584] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:41:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:41:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-10fe70d9-fd6d-4fe3-8ae6-c0a16eb20f4f tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:32 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-10fe70d9-fd6d-4fe3-8ae6-c0a16eb20f4f tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:32 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-10fe70d9-fd6d-4fe3-8ae6-c0a16eb20f4f tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fe6fed1a5a43e5bd0925b92486ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f984af8c7048c7ba68c1530be9cc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-10fe70d9-fd6d-4fe3-8ae6-c0a16eb20f4f tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab" status: 200 len: 1208 microversion: 2.1 time: 0.063115 Apr 12 03:41:32 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 196/585] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:32 2023] GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab => generated 1208 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:41:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-33127330-d8aa-4f1c-8701-a0f76aa798ba req-2e6ca5e2-939f-4b43-a71b-ed3885a130ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-33127330-d8aa-4f1c-8701-a0f76aa798ba req-2e6ca5e2-939f-4b43-a71b-ed3885a130ec service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-33127330-d8aa-4f1c-8701-a0f76aa798ba req-2e6ca5e2-939f-4b43-a71b-ed3885a130ec service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-33127330-d8aa-4f1c-8701-a0f76aa798ba req-2e6ca5e2-939f-4b43-a71b-ed3885a130ec service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-33127330-d8aa-4f1c-8701-a0f76aa798ba req-2e6ca5e2-939f-4b43-a71b-ed3885a130ec service nova] Creating event network-changed:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:41:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-33127330-d8aa-4f1c-8701-a0f76aa798ba req-2e6ca5e2-939f-4b43-a71b-ed3885a130ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034470 Apr 12 03:41:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 195/586] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2f86577b-50f8-4e93-8431-6c1d1caab2d0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 200 len: 1549 microversion: 2.1 time: 0.212101 Apr 12 03:41:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 196/587] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:37 2023] GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:41:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c37568ee-440b-48e8-af85-83ba290ac95e req-3d85a133-88d9-4ec7-8e4c-f907a8d4c4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c37568ee-440b-48e8-af85-83ba290ac95e req-3d85a133-88d9-4ec7-8e4c-f907a8d4c4c3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c37568ee-440b-48e8-af85-83ba290ac95e req-3d85a133-88d9-4ec7-8e4c-f907a8d4c4c3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c37568ee-440b-48e8-af85-83ba290ac95e req-3d85a133-88d9-4ec7-8e4c-f907a8d4c4c3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c37568ee-440b-48e8-af85-83ba290ac95e req-3d85a133-88d9-4ec7-8e4c-f907a8d4c4c3 service nova] Creating event network-vif-plugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:41:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c37568ee-440b-48e8-af85-83ba290ac95e req-3d85a133-88d9-4ec7-8e4c-f907a8d4c4c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031517 Apr 12 03:41:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 197/588] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:41:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-23f7af81-6f12-4b49-9115-195dead30880 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 204 len: 0 microversion: 2.1 time: 0.150076 Apr 12 03:41:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 196/589] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:41:37 2023] DELETE /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:38 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-77c6b631-ae77-4021-a5fd-466003f7ef8d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 200 len: 1555 microversion: 2.1 time: 0.299729 Apr 12 03:41:38 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-8a079f44-27bf-4946-9729-6f5485d930f6 req-75d24ab6-1920-4443-a0b5-4abe4811190a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211dca2-af04-4dd3-b747-cc3bbd8d310b", "name": "network-vif-unplugged", "status": "completed", "tag": "db8f85d3-266d-4a25-b809-3f4cf95a54d7"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:38 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 197/590] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:37 2023] GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 1555 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:41:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8a079f44-27bf-4946-9729-6f5485d930f6 req-75d24ab6-1920-4443-a0b5-4abe4811190a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8a079f44-27bf-4946-9729-6f5485d930f6 req-75d24ab6-1920-4443-a0b5-4abe4811190a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8a079f44-27bf-4946-9729-6f5485d930f6 req-75d24ab6-1920-4443-a0b5-4abe4811190a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:38 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-8a079f44-27bf-4946-9729-6f5485d930f6 req-75d24ab6-1920-4443-a0b5-4abe4811190a service nova] Creating event network-vif-unplugged:db8f85d3-266d-4a25-b809-3f4cf95a54d7 for instance d211dca2-af04-4dd3-b747-cc3bbd8d310b on user Apr 12 03:41:38 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-8a079f44-27bf-4946-9729-6f5485d930f6 req-75d24ab6-1920-4443-a0b5-4abe4811190a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031590 Apr 12 03:41:38 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 198/591] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:39 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}, {"server_uuid": "d211dca2-af04-4dd3-b747-cc3bbd8d310b", "name": "network-vif-deleted", "tag": "db8f85d3-266d-4a25-b809-3f4cf95a54d7"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:39 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:39 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] Creating event network-vif-plugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:41:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] Creating event network-vif-deleted:db8f85d3-266d-4a25-b809-3f4cf95a54d7 for instance d211dca2-af04-4dd3-b747-cc3bbd8d310b on user Apr 12 03:41:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-e0d1937c-10a7-4033-ae53-94dcbdceee72 req-3120b1d0-1ee6-4469-9480-34d8816b9188 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045998 Apr 12 03:41:39 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 197/592] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-bd6ff5e5-92e4-473c-a4f6-296fd8d151fa req-b3877949-b848-4918-9f22-d7cc85e0afaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211dca2-af04-4dd3-b747-cc3bbd8d310b", "name": "network-vif-plugged", "status": "completed", "tag": "db8f85d3-266d-4a25-b809-3f4cf95a54d7"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bd6ff5e5-92e4-473c-a4f6-296fd8d151fa req-b3877949-b848-4918-9f22-d7cc85e0afaa service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bd6ff5e5-92e4-473c-a4f6-296fd8d151fa req-b3877949-b848-4918-9f22-d7cc85e0afaa service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bd6ff5e5-92e4-473c-a4f6-296fd8d151fa req-b3877949-b848-4918-9f22-d7cc85e0afaa service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-bd6ff5e5-92e4-473c-a4f6-296fd8d151fa req-b3877949-b848-4918-9f22-d7cc85e0afaa service nova] Creating event network-vif-plugged:db8f85d3-266d-4a25-b809-3f4cf95a54d7 for instance d211dca2-af04-4dd3-b747-cc3bbd8d310b on user Apr 12 03:41:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-bd6ff5e5-92e4-473c-a4f6-296fd8d151fa req-b3877949-b848-4918-9f22-d7cc85e0afaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073734 Apr 12 03:41:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 198/593] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:41:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1156151605", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "destination_type": "volume"}], "networks": [{"uuid": "f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] validate_networks() for [('f6dd0ec8-a058-4dfb-ac0a-805fe5dc7265', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Getting quotas for user d99be569057f432484e4a60b46882bbd and project 6e1fa352a8c144a1aada7ce0d8818429. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:41:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:41:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-58209f43-4f79-4263-b69f-9ac01062ee7d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.618225 Apr 12 03:41:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 199/594] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 03:41:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 03:41:41 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-812a7527-9178-4d2b-bdfa-988e7ad9c4c6 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:41 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-812a7527-9178-4d2b-bdfa-988e7ad9c4c6 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:41 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-812a7527-9178-4d2b-bdfa-988e7ad9c4c6 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:41 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-812a7527-9178-4d2b-bdfa-988e7ad9c4c6 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:41 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-812a7527-9178-4d2b-bdfa-988e7ad9c4c6 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-812a7527-9178-4d2b-bdfa-988e7ad9c4c6 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1395 microversion: 2.87 time: 0.082091 Apr 12 03:41:41 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 198/595] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:41:41 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1395 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] [instance: a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] HTTP exception thrown: Instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 could not be found. Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Request method failure captured: Apr 12 03:41:42 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 HTTP/1.1 Apr 12 03:41:42 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:41:42 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:41:42 user devstack@n-api.service[62074]: Connection: close Apr 12 03:41:42 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:41:42 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:41:42 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:41:42 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:41:42 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibn9epN0mfwnKT-VX18PrxsMFHZa41bjt-fcBEsi4_dhzp0ESjAhXT8BgQ30UnVHjLZla6UzSIWAE7ai68FjLMYW3qVzXMcKXibLe0bYhdMjUh97ZWYfcpFJOCQJ4PFsq1Ksskm2eq5i2co7LFLimjLi3RX1L_6X58lH0kphU4O5-c Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Project-Id: f4cce206e2b94b03ade2d310373c5ca2 Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesAdminNegativeTest-2105871059 Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4cce206e2b94b03ade2d310373c5ca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4cce206e2b94b03ade2d310373c5ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4cce206e2b94b03ade2d310373c5ca2"}]}] Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesAdminNegativeTest-2105871059 Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Tenant-Id: f4cce206e2b94b03ade2d310373c5ca2 Apr 12 03:41:42 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2105871059 Apr 12 03:41:42 user devstack@n-api.service[62074]: X-User: tempest-VolumesAdminNegativeTest-2105871059-project-member Apr 12 03:41:42 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:41:42 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:41:42 user devstack@n-api.service[62074]: X-User-Id: e2f496e5fe694d46a9803f797743a7dc Apr 12 03:41:42 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesAdminNegativeTest-2105871059-project-member Apr 12 03:41:42 user devstack@n-api.service[62074]: method: > Apr 12 03:41:42 user devstack@n-api.service[62074]: exception: Instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 could not be found. Apr 12 03:41:42 user devstack@n-api.service[62074]: action_args: {'id': 'a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6'} Apr 12 03:41:42 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 could not be found. Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 could not be found. Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 could not be found. Apr 12 03:41:42 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:41:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Returning 404 to user: Instance a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:41:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6713560e-3285-4e78-a10b-503dcbf3a320 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6" status: 404 len: 111 microversion: 2.1 time: 0.042780 Apr 12 03:41:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 199/596] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:42 2023] GET /compute/v2.1/servers/a7f8feb8-9f2d-4cf4-b973-60b04c5d02b6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 03:41:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4f279f9a-1a01-4909-afcd-d13f41ef1b41 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] Calling method '.version_select at 0x7f76a6aa1ea0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4f279f9a-1a01-4909-afcd-d13f41ef1b41 tempest-VolumesAdminNegativeTest-2105871059 tempest-VolumesAdminNegativeTest-2105871059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-315148094" status: 202 len: 0 microversion: 2.1 time: 0.023714 Apr 12 03:41:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:41:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-315148094 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:41:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7b4f0d48-85f4-4627-a433-11cebaa8ee0a req-fb227d8c-a9ed-41c1-9f83-804eaa334f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7b4f0d48-85f4-4627-a433-11cebaa8ee0a req-fb227d8c-a9ed-41c1-9f83-804eaa334f7b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7b4f0d48-85f4-4627-a433-11cebaa8ee0a req-fb227d8c-a9ed-41c1-9f83-804eaa334f7b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7b4f0d48-85f4-4627-a433-11cebaa8ee0a req-fb227d8c-a9ed-41c1-9f83-804eaa334f7b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7b4f0d48-85f4-4627-a433-11cebaa8ee0a req-fb227d8c-a9ed-41c1-9f83-804eaa334f7b service nova] Creating event network-changed:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:41:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7b4f0d48-85f4-4627-a433-11cebaa8ee0a req-fb227d8c-a9ed-41c1-9f83-804eaa334f7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035397 Apr 12 03:41:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 199/598] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-8c13e802-252d-4bb7-8d0e-1b43c91889c4 req-d2320cd4-8c2f-4eb7-9c91-900235fa3d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:56 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=20 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8c13e802-252d-4bb7-8d0e-1b43c91889c4 req-d2320cd4-8c2f-4eb7-9c91-900235fa3d73 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8c13e802-252d-4bb7-8d0e-1b43c91889c4 req-d2320cd4-8c2f-4eb7-9c91-900235fa3d73 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8c13e802-252d-4bb7-8d0e-1b43c91889c4 req-d2320cd4-8c2f-4eb7-9c91-900235fa3d73 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-8c13e802-252d-4bb7-8d0e-1b43c91889c4 req-d2320cd4-8c2f-4eb7-9c91-900235fa3d73 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:41:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-8c13e802-252d-4bb7-8d0e-1b43c91889c4 req-d2320cd4-8c2f-4eb7-9c91-900235fa3d73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039350 Apr 12 03:41:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 200/599] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:56 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:41:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7a05a4d7-d71b-4f20-97b9-cdeab1b2de62 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1678 microversion: 2.1 time: 0.227464 Apr 12 03:41:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 201/600] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:41:56 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8278d82d-cc19-4660-b4f1-b13d92e7d742"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-30fb675a-f318-4c7a-9d68-849294e7d1ea tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304080 Apr 12 03:41:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 200/601] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:41:56 2023] POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:58 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-f9c7653b-c0fd-4e80-a132-7f60bbfcd2d8 req-2a61325e-f2b9-4685-aecc-f02559d7e045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f9c7653b-c0fd-4e80-a132-7f60bbfcd2d8 req-2a61325e-f2b9-4685-aecc-f02559d7e045 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:41:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f9c7653b-c0fd-4e80-a132-7f60bbfcd2d8 req-2a61325e-f2b9-4685-aecc-f02559d7e045 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:41:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f9c7653b-c0fd-4e80-a132-7f60bbfcd2d8 req-2a61325e-f2b9-4685-aecc-f02559d7e045 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:41:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f9c7653b-c0fd-4e80-a132-7f60bbfcd2d8 req-2a61325e-f2b9-4685-aecc-f02559d7e045 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:41:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-f9c7653b-c0fd-4e80-a132-7f60bbfcd2d8 req-2a61325e-f2b9-4685-aecc-f02559d7e045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059122 Apr 12 03:41:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 201/602] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:41:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:41:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-58aac7ab-b92b-4004-a9f9-6fa448b7d4f2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: .version_select at 0x7f76a69532e0>, body: {"keypair": {"name": "tempest-keypair-611227490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsSrynzjRvdumscunYM7qq2LINQa1dLMdBCKJ6XwNU+wH30BpZ+UxgkL98cPRjcfl2uMCQ+6nM9+XV2FMWC/Uf6P+0R1p0Yeexa689yM1BKJkKUWaai92yYlAVXCdH/1Q=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:41:59 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-58aac7ab-b92b-4004-a9f9-6fa448b7d4f2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for project a341e582192a47548df8627d82c96ea8. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:41:59 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-58aac7ab-b92b-4004-a9f9-6fa448b7d4f2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for user 872fbc3d59274cd480c17b4b7342499a and project a341e582192a47548df8627d82c96ea8. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:41:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-58aac7ab-b92b-4004-a9f9-6fa448b7d4f2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153719 Apr 12 03:41:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 202/603] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:41:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2123178219", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4bee7b8b-6409-4a1e-ab1e-480450f73fe5"}], "security_groups": [{"name": "tempest-securitygroup--1071229621"}], "key_name": "tempest-keypair-611227490", "user_data": "}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] validate_networks() for [('4bee7b8b-6409-4a1e-ab1e-480450f73fe5', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:01 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for project a341e582192a47548df8627d82c96ea8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:42:02 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for user 872fbc3d59274cd480c17b4b7342499a and project a341e582192a47548df8627d82c96ea8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:42:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:42:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:42:02 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-40783728-6a3d-4cff-b166-3d4f72f27cdc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.654720 Apr 12 03:42:02 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 201/604] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:42:01 2023] POST /compute/v2.1/servers => generated 400 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:42:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d40a80da-7b7a-4a37-a4a7-876ef08ba17e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:02 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d40a80da-7b7a-4a37-a4a7-876ef08ba17e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:02 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-d40a80da-7b7a-4a37-a4a7-876ef08ba17e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d40a80da-7b7a-4a37-a4a7-876ef08ba17e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1231 microversion: 2.1 time: 0.084422 Apr 12 03:42:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 202/605] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:02 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1231 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Old instance type m1.nano, new instance type m1.micro {{(pid=62072) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:42:04 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:42:04 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9f05d6f1-9239-4381-880d-65d435739855 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.287513 Apr 12 03:42:04 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 203/606] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:42:04 2023] POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0cdca030-ad03-4f66-8327-e80beffe1b57 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1733 microversion: 2.1 time: 0.254732 Apr 12 03:42:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 202/607] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:04 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ae2a6615-d067-4aec-9d8c-803e68d98f9d req-f656e22c-5738-4e45-b154-3b8c4858f0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ae2a6615-d067-4aec-9d8c-803e68d98f9d req-f656e22c-5738-4e45-b154-3b8c4858f0f7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ae2a6615-d067-4aec-9d8c-803e68d98f9d req-f656e22c-5738-4e45-b154-3b8c4858f0f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ae2a6615-d067-4aec-9d8c-803e68d98f9d req-f656e22c-5738-4e45-b154-3b8c4858f0f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ae2a6615-d067-4aec-9d8c-803e68d98f9d req-f656e22c-5738-4e45-b154-3b8c4858f0f7 service nova] Creating event network-changed:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:42:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ae2a6615-d067-4aec-9d8c-803e68d98f9d req-f656e22c-5738-4e45-b154-3b8c4858f0f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037784 Apr 12 03:42:04 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 203/608] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-30442059-c7b4-425d-a47f-319d3492d189 req-7012b597-4af4-4f65-936d-ab571b6395a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-30442059-c7b4-425d-a47f-319d3492d189 req-7012b597-4af4-4f65-936d-ab571b6395a0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-30442059-c7b4-425d-a47f-319d3492d189 req-7012b597-4af4-4f65-936d-ab571b6395a0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-30442059-c7b4-425d-a47f-319d3492d189 req-7012b597-4af4-4f65-936d-ab571b6395a0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:07 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-bb630115-614e-4a8f-9272-4cd58e4f3733 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1704 microversion: 2.20 time: 0.372916 Apr 12 03:42:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 204/609] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:42:07 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1704 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:42:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-30442059-c7b4-425d-a47f-319d3492d189 req-7012b597-4af4-4f65-936d-ab571b6395a0 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:42:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-30442059-c7b4-425d-a47f-319d3492d189 req-7012b597-4af4-4f65-936d-ab571b6395a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118669 Apr 12 03:42:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 203/610] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-unplugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] Creating event network-vif-unplugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:42:07 user devstack@n-api.service[62074]: DEBUG nova.compute.api [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62074) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:42:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-8a3e649d-6306-41e3-91fa-f47b8e0005d0 req-cb1921e0-28c7-4201-94f7-c5d3515b00d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063582 Apr 12 03:42:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 204/611] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:08 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:08 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-92aeb087-28c6-4c43-af52-d710fb8f40c2 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1535 microversion: 2.1 time: 0.215141 Apr 12 03:42:08 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 205/612] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:07 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1535 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Searching by: {'deleted': False, 'project_id': '05e1e25933cd42df98fb060b8d2701dc'} {{(pid=62073) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:08 user devstack@n-api.service[62073]: DEBUG nova.compute.multi_cell_list [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=62073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 03:42:08 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d19df488-f84b-423c-bae9-b10f31ba006d tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.260474 Apr 12 03:42:08 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 204/613] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 03:42:08 2023] GET /compute/v2.1/servers => generated 340 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:08 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:08 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f394d0d2-cb9c-4c66-908b-39c431200f0a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1535 microversion: 2.1 time: 0.200979 Apr 12 03:42:08 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 205/614] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:08 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1535 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:09 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-46f20efc-9329-445b-9f9b-d2ee7b6c7d63 req-f4ee2ece-5eb2-4b42-8562-f9fe7f212b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-46f20efc-9329-445b-9f9b-d2ee7b6c7d63 req-f4ee2ece-5eb2-4b42-8562-f9fe7f212b28 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-46f20efc-9329-445b-9f9b-d2ee7b6c7d63 req-f4ee2ece-5eb2-4b42-8562-f9fe7f212b28 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-46f20efc-9329-445b-9f9b-d2ee7b6c7d63 req-f4ee2ece-5eb2-4b42-8562-f9fe7f212b28 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-46f20efc-9329-445b-9f9b-d2ee7b6c7d63 req-f4ee2ece-5eb2-4b42-8562-f9fe7f212b28 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:42:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-46f20efc-9329-445b-9f9b-d2ee7b6c7d63 req-f4ee2ece-5eb2-4b42-8562-f9fe7f212b28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031890 Apr 12 03:42:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 206/615] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:42:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:42:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-3c33b550-5ab7-4e15-a995-58f662760a94 req-3ab71e31-3822-438d-bbec-3730f8bae031 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048571 Apr 12 03:42:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 205/616] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8568ebe9-126e-4516-87a9-cd53c4b520c3"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3abbfb3f-ffc6-4be8-b223-3f6f78823019 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334884 Apr 12 03:42:11 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 206/617] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:42:11 2023] POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:19 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:19 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-0dd346d0-50cf-4882-9845-ad4ae7101cc7 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1581 microversion: 2.1 time: 0.164417 Apr 12 03:42:19 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 207/618] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:19 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1581 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:42:21 user devstack@n-api.service[62073]: DEBUG nova.compute.api [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:42:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f0037c84-4db8-4389-a6aa-286d05de0552 req-df347726-c339-4798-97d4-2235aa9fd51f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064892 Apr 12 03:42:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 206/619] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=16 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:22 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fe6fed1a5a43e5bd0925b92486ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f984af8c7048c7ba68c1530be9cc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:22 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c8b8c2c5-c4e4-4b87-8573-3bbde49cccf6 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab" status: 200 len: 1485 microversion: 2.1 time: 0.230031 Apr 12 03:42:22 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 207/620] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:22 2023] GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab => generated 1485 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1409013015"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:23 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}, {"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:23 user devstack@n-api.service[62072]: INFO nova.network.security_group_api [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Adding security group 1946dd38-3eb4-4fb3-b64f-f1e42a21a6cc to port c904583a-ea96-45c9-ad62-d5e0cc68031f Apr 12 03:42:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Creating event network-changed:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:42:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:42:23 user devstack@n-api.service[62073]: DEBUG nova.compute.api [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:42:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-cc94be43-c143-44f9-a7c6-06a58516050f req-fb36c644-1320-4069-b701-f9ce0e930d5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.091905 Apr 12 03:42:23 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 207/621] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9b3187b3-69ca-471f-add8-504c6f4ecb15 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/action" status: 202 len: 0 microversion: 2.1 time: 0.954760 Apr 12 03:42:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 208/622] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:42:23 2023] POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/action => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b63a93d5-09e1-4c3b-8339-3e175a70fb7b req-40eae762-6108-4d4d-b386-1760df13ef84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b63a93d5-09e1-4c3b-8339-3e175a70fb7b req-40eae762-6108-4d4d-b386-1760df13ef84 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b63a93d5-09e1-4c3b-8339-3e175a70fb7b req-40eae762-6108-4d4d-b386-1760df13ef84 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b63a93d5-09e1-4c3b-8339-3e175a70fb7b req-40eae762-6108-4d4d-b386-1760df13ef84 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b63a93d5-09e1-4c3b-8339-3e175a70fb7b req-40eae762-6108-4d4d-b386-1760df13ef84 service nova] Creating event network-changed:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:42:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b63a93d5-09e1-4c3b-8339-3e175a70fb7b req-40eae762-6108-4d4d-b386-1760df13ef84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 Apr 12 03:42:24 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 208/623] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:24 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9d9114af-63dd-40be-81d2-c96b430efa3f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1628 microversion: 2.1 time: 0.206541 Apr 12 03:42:24 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:24 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1628 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c54adbd6-a396-4cb6-a0d5-cd6fe0bdef71 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/action" status: 202 len: 0 microversion: 2.1 time: 0.115462 Apr 12 03:42:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 209/625] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:42:24 2023] POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:25 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-d502d553-4227-4fb8-9b0a-0c2dc92cf66e tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1738 microversion: 2.1 time: 0.324337 Apr 12 03:42:25 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 209/626] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:24 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:42:28 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b HTTP/1.1 Apr 12 03:42:28 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:42:28 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:42:28 user devstack@n-api.service[62074]: Connection: close Apr 12 03:42:28 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:42:28 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:42:28 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:42:28 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:42:28 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:42:28 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:42:28 user devstack@n-api.service[62074]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:42:28 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:42:28 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:42:28 user devstack@n-api.service[62074]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:42:28 user devstack@n-api.service[62074]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:42:28 user devstack@n-api.service[62074]: method: > Apr 12 03:42:28 user devstack@n-api.service[62074]: exception: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:42:28 user devstack@n-api.service[62074]: action_args: {'id': 'd211dca2-af04-4dd3-b747-cc3bbd8d310b'} Apr 12 03:42:28 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:42:28 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:42:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:42:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f9a78c18-7f9c-4a36-981a-2608eab233ea tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 404 len: 111 microversion: 2.1 time: 0.032332 Apr 12 03:42:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 209/627] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:28 2023] GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:28 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:28 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-eb1366d1-8e9f-485e-bb13-1fca8cab2ab2 req-9327de2c-360a-403e-9999-fec6a03dbdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-unplugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-eb1366d1-8e9f-485e-bb13-1fca8cab2ab2 req-9327de2c-360a-403e-9999-fec6a03dbdcc service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-eb1366d1-8e9f-485e-bb13-1fca8cab2ab2 req-9327de2c-360a-403e-9999-fec6a03dbdcc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-eb1366d1-8e9f-485e-bb13-1fca8cab2ab2 req-9327de2c-360a-403e-9999-fec6a03dbdcc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-eb1366d1-8e9f-485e-bb13-1fca8cab2ab2 req-9327de2c-360a-403e-9999-fec6a03dbdcc service nova] Creating event network-vif-unplugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:42:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-eb1366d1-8e9f-485e-bb13-1fca8cab2ab2 req-9327de2c-360a-403e-9999-fec6a03dbdcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032887 Apr 12 03:42:28 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 210/628] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c3f105f3-033e-4e98-931f-ac70f5f7bc2c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.137833 Apr 12 03:42:28 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 210/629] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:42:28 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/os-interface => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:29 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ccd95568-d458-4ddb-9731-c916aeb658f7 req-f207340a-bcba-4921-b6ee-551f42e6c98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ccd95568-d458-4ddb-9731-c916aeb658f7 req-f207340a-bcba-4921-b6ee-551f42e6c98b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ccd95568-d458-4ddb-9731-c916aeb658f7 req-f207340a-bcba-4921-b6ee-551f42e6c98b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ccd95568-d458-4ddb-9731-c916aeb658f7 req-f207340a-bcba-4921-b6ee-551f42e6c98b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:29 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ccd95568-d458-4ddb-9731-c916aeb658f7 req-f207340a-bcba-4921-b6ee-551f42e6c98b service nova] Creating event network-changed:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:42:29 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ccd95568-d458-4ddb-9731-c916aeb658f7 req-f207340a-bcba-4921-b6ee-551f42e6c98b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028778 Apr 12 03:42:29 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 210/630] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:42:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-2f8b05fe-d3e6-4048-aacb-5cf6ebca19c2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 204 len: 0 microversion: 2.1 time: 0.120809 Apr 12 03:42:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 211/631] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:42:30 2023] DELETE /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9bc23c84-0b3d-48e0-a908-0f9ec826df4b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 200 len: 1398 microversion: 2.1 time: 0.170771 Apr 12 03:42:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 211/632] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:30 2023] GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 1398 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-plugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}, {"server_uuid": "1eef2c91-dfad-43aa-b193-25970db83b79", "name": "network-vif-unplugged", "status": "completed", "tag": "50b78ba6-f017-4643-a2ec-fa0f348bb270"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:30 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] Creating event network-vif-plugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:42:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] Creating event network-vif-unplugged:50b78ba6-f017-4643-a2ec-fa0f348bb270 for instance 1eef2c91-dfad-43aa-b193-25970db83b79 on user Apr 12 03:42:30 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-a78207d1-f1dd-451d-836a-4bf1b22178b7 req-e308d034-a68d-45d3-a525-79412bca0bf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036858 Apr 12 03:42:30 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 212/633] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:31 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-cdde6de4-e16f-4e10-8e4c-2da9ae33108c tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/ips" status: 200 len: 147 microversion: 2.1 time: 0.068397 Apr 12 03:42:31 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 211/634] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:42:30 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/ips => generated 147 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "492e66f2-98d6-43d6-bbe6-cbe61f9335f6"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Invalid volume: volume 492e66f2-98d6-43d6-bbe6-cbe61f9335f6 is already attached to instances: f73fa883-75f0-4593-a89c-d009c6d4ebf0 Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:42:31 user devstack@n-api.service[62072]: request: POST /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/os-volume_attachments HTTP/1.1 Apr 12 03:42:31 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:42:31 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:42:31 user devstack@n-api.service[62072]: Connection: close Apr 12 03:42:31 user devstack@n-api.service[62072]: Content-Length: 74 Apr 12 03:42:31 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:42:31 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:42:31 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:42:31 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:42:31 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:42:31 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:42:31 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:42:31 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:42:31 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:42:31 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:42:31 user devstack@n-api.service[62072]: Apr 12 03:42:31 user devstack@n-api.service[62072]: {"volumeAttachment": {"volumeId": "492e66f2-98d6-43d6-bbe6-cbe61f9335f6"}} Apr 12 03:42:31 user devstack@n-api.service[62072]: method: > Apr 12 03:42:31 user devstack@n-api.service[62072]: exception: Invalid volume: volume 492e66f2-98d6-43d6-bbe6-cbe61f9335f6 is already attached to instances: f73fa883-75f0-4593-a89c-d009c6d4ebf0 Apr 12 03:42:31 user devstack@n-api.service[62072]: action_args: {'server_id': '117ea473-f8e3-43c7-8406-d4590422cc0b', 'body': {'volumeAttachment': {'volumeId': '492e66f2-98d6-43d6-bbe6-cbe61f9335f6'}}} Apr 12 03:42:31 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 492e66f2-98d6-43d6-bbe6-cbe61f9335f6 is already attached to instances: f73fa883-75f0-4593-a89c-d009c6d4ebf0 Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 492e66f2-98d6-43d6-bbe6-cbe61f9335f6 is already attached to instances: f73fa883-75f0-4593-a89c-d009c6d4ebf0 Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 492e66f2-98d6-43d6-bbe6-cbe61f9335f6 is already attached to instances: f73fa883-75f0-4593-a89c-d009c6d4ebf0 Apr 12 03:42:31 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 400 to user: Invalid volume: volume 492e66f2-98d6-43d6-bbe6-cbe61f9335f6 is already attached to instances: f73fa883-75f0-4593-a89c-d009c6d4ebf0 {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:42:31 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-73b78d83-8e90-4a11-b276-241e04be45a9 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104794 Apr 12 03:42:31 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 212/635] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:42:31 2023] POST /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:42:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-431a073c-ab43-4d1d-bece-e405cdd0564b tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 204 len: 0 microversion: 2.1 time: 0.116911 Apr 12 03:42:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 213/636] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:42:31 2023] DELETE /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:31 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e9178e8c-8cd0-45f9-b540-986828356b6d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 200 len: 1668 microversion: 2.1 time: 0.273872 Apr 12 03:42:31 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 212/637] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:31 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 1668 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:31 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:31 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-fc9b2f5b-e977-4a14-a5e6-d37e7988a165 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1769 microversion: 2.87 time: 0.210499 Apr 12 03:42:31 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 213/638] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:42:31 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1769 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:42:33 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eef2c91-dfad-43aa-b193-25970db83b79", "name": "network-vif-plugged", "status": "completed", "tag": "50b78ba6-f017-4643-a2ec-fa0f348bb270"}, {"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-plugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}, {"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-plugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}, {"server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "name": "network-vif-unplugged", "status": "completed", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}, {"server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "name": "network-vif-plugged", "status": "completed", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Creating event network-vif-plugged:50b78ba6-f017-4643-a2ec-fa0f348bb270 for instance 1eef2c91-dfad-43aa-b193-25970db83b79 on user Apr 12 03:42:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Creating event network-vif-plugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:42:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Creating event network-vif-plugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:42:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Creating event network-vif-unplugged:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:42:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] Creating event network-vif-plugged:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:42:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f931700c-6e44-4927-9711-a9ab2a77a960 req-922127b7-4348-4638-9be8-90f672746d88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.039619 Apr 12 03:42:33 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 214/639] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:33 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-744b6933-2c1f-4a39-9220-0395672bde40 req-578e380e-b961-467d-8af1-3fcf1403ac30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eef2c91-dfad-43aa-b193-25970db83b79", "name": "network-vif-deleted", "tag": "50b78ba6-f017-4643-a2ec-fa0f348bb270"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-744b6933-2c1f-4a39-9220-0395672bde40 req-578e380e-b961-467d-8af1-3fcf1403ac30 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-744b6933-2c1f-4a39-9220-0395672bde40 req-578e380e-b961-467d-8af1-3fcf1403ac30 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-744b6933-2c1f-4a39-9220-0395672bde40 req-578e380e-b961-467d-8af1-3fcf1403ac30 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-744b6933-2c1f-4a39-9220-0395672bde40 req-578e380e-b961-467d-8af1-3fcf1403ac30 service nova] Creating event network-vif-deleted:50b78ba6-f017-4643-a2ec-fa0f348bb270 for instance 1eef2c91-dfad-43aa-b193-25970db83b79 on user Apr 12 03:42:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-744b6933-2c1f-4a39-9220-0395672bde40 req-578e380e-b961-467d-8af1-3fcf1403ac30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602678 Apr 12 03:42:33 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 213/640] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:42:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-8c10da47-71cd-47bf-a385-e2f50584a437 req-2d334c7f-3d4a-40ca-b370-da840a4db611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ea473-f8e3-43c7-8406-d4590422cc0b", "name": "network-vif-deleted", "tag": "ec1c8d01-1c15-4a89-9205-23f04ec6fc58"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:42:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c10da47-71cd-47bf-a385-e2f50584a437 req-2d334c7f-3d4a-40ca-b370-da840a4db611 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c10da47-71cd-47bf-a385-e2f50584a437 req-2d334c7f-3d4a-40ca-b370-da840a4db611 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8c10da47-71cd-47bf-a385-e2f50584a437 req-2d334c7f-3d4a-40ca-b370-da840a4db611 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-8c10da47-71cd-47bf-a385-e2f50584a437 req-2d334c7f-3d4a-40ca-b370-da840a4db611 service nova] Creating event network-vif-deleted:ec1c8d01-1c15-4a89-9205-23f04ec6fc58 for instance 117ea473-f8e3-43c7-8406-d4590422cc0b on user Apr 12 03:42:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-8c10da47-71cd-47bf-a385-e2f50584a437 req-2d334c7f-3d4a-40ca-b370-da840a4db611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041675 Apr 12 03:42:35 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 214/641] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:42:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:52 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-5fa86e0f-1cbb-49d8-ab53-e6d3fb10083b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1538 microversion: 2.1 time: 0.222706 Apr 12 03:42:52 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 215/642] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:52 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1538 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=14 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=28 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:42:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:42:55 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:42:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-7c12b239-95d0-4041-9e72-692f46f49acd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1732 microversion: 2.1 time: 0.165901 Apr 12 03:42:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 214/643] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:42:54 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=11 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=23 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-04dbdc0b-f435-476e-887a-ba763f8f08ce tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046429 Apr 12 03:43:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 215/644] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 03:43:07 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:08 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:43:08 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cd85aefe-22ee-42f6-8afe-be96d01ae05f tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 204 len: 0 microversion: 2.20 time: 0.127068 Apr 12 03:43:08 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 216/645] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:43:07 2023] DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:08 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1fe5db01624224ab7b615c908d990b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738ebb6b798c4974aa46f9bbe3828279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:08 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8f389d10-4cc3-40dd-b645-367d38bbcac4 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 200 len: 1710 microversion: 2.20 time: 0.195081 Apr 12 03:43:08 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 215/646] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:43:08 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:43:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-a7df4609-d687-4773-b5b3-a8184d925b6b req-70c5a9ce-d503-4485-993e-42a595cb6c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-unplugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a7df4609-d687-4773-b5b3-a8184d925b6b req-70c5a9ce-d503-4485-993e-42a595cb6c60 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a7df4609-d687-4773-b5b3-a8184d925b6b req-70c5a9ce-d503-4485-993e-42a595cb6c60 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a7df4609-d687-4773-b5b3-a8184d925b6b req-70c5a9ce-d503-4485-993e-42a595cb6c60 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:08 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a7df4609-d687-4773-b5b3-a8184d925b6b req-70c5a9ce-d503-4485-993e-42a595cb6c60 service nova] Creating event network-vif-unplugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:43:08 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-a7df4609-d687-4773-b5b3-a8184d925b6b req-70c5a9ce-d503-4485-993e-42a595cb6c60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029812 Apr 12 03:43:08 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 216/647] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:10 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-plugged", "status": "completed", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}, {"server_uuid": "06481254-722a-4053-a6af-11f5dcc68636", "name": "network-vif-deleted", "tag": "5861aafc-4312-4d82-965c-2d1d993d8ea0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:10 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] Creating event network-vif-plugged:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:43:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] Creating event network-vif-deleted:5861aafc-4312-4d82-965c-2d1d993d8ea0 for instance 06481254-722a-4053-a6af-11f5dcc68636 on user Apr 12 03:43:10 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-88ef4302-4ba1-476d-8ec4-877ece6b1c49 req-99e539c5-3569-4b75-8906-6ff253356abb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032885 Apr 12 03:43:10 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 217/648] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:15 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2274a7ae-ae72-475f-b4a7-527916227185 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1746 microversion: 2.1 time: 0.190660 Apr 12 03:43:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 216/649] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:15 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1746 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:43:20 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 HTTP/1.1 Apr 12 03:43:20 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:43:20 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:43:20 user devstack@n-api.service[62072]: Connection: close Apr 12 03:43:20 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:43:20 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:43:20 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:43:20 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:43:20 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:20 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62072]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:20 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:43:20 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:43:20 user devstack@n-api.service[62072]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:43:20 user devstack@n-api.service[62072]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:20 user devstack@n-api.service[62072]: method: > Apr 12 03:43:20 user devstack@n-api.service[62072]: exception: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:20 user devstack@n-api.service[62072]: action_args: {'id': '1eef2c91-dfad-43aa-b193-25970db83b79'} Apr 12 03:43:20 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:20 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1ba38450-1447-46f5-88bc-045b6cbcd1db tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 404 len: 111 microversion: 2.1 time: 0.036606 Apr 12 03:43:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 217/650] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:20 2023] GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:20 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:43:20 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b HTTP/1.1 Apr 12 03:43:20 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:43:20 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:43:20 user devstack@n-api.service[62073]: Connection: close Apr 12 03:43:20 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:43:20 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:43:20 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:43:20 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:43:20 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:20 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62073]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:20 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:43:20 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:43:20 user devstack@n-api.service[62073]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:43:20 user devstack@n-api.service[62073]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:20 user devstack@n-api.service[62073]: method: > Apr 12 03:43:20 user devstack@n-api.service[62073]: exception: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62073]: action_args: {'id': 'd211dca2-af04-4dd3-b747-cc3bbd8d310b'} Apr 12 03:43:20 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:20 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-25fb7f74-238f-4b36-a7cc-b6cfac8d0b54 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 404 len: 111 microversion: 2.1 time: 0.043047 Apr 12 03:43:20 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 218/651] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:43:20 2023] DELETE /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: d211dca2-af04-4dd3-b747-cc3bbd8d310b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:43:20 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b HTTP/1.1 Apr 12 03:43:20 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:43:20 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:43:20 user devstack@n-api.service[62074]: Connection: close Apr 12 03:43:20 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:43:20 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:43:20 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:43:20 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:43:20 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:20 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:20 user devstack@n-api.service[62074]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:20 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:43:20 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:43:20 user devstack@n-api.service[62074]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:43:20 user devstack@n-api.service[62074]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:20 user devstack@n-api.service[62074]: method: > Apr 12 03:43:20 user devstack@n-api.service[62074]: exception: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62074]: action_args: {'id': 'd211dca2-af04-4dd3-b747-cc3bbd8d310b'} Apr 12 03:43:20 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. Apr 12 03:43:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:43:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance d211dca2-af04-4dd3-b747-cc3bbd8d310b could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2e5bc0a2-6b10-430d-a37e-1814b1110b41 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b" status: 404 len: 111 microversion: 2.1 time: 0.028538 Apr 12 03:43:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 217/652] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:20 2023] GET /compute/v2.1/servers/d211dca2-af04-4dd3-b747-cc3bbd8d310b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:43:21 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 HTTP/1.1 Apr 12 03:43:21 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:43:21 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:43:21 user devstack@n-api.service[62072]: Connection: close Apr 12 03:43:21 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:43:21 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:43:21 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:43:21 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:43:21 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:21 user devstack@n-api.service[62072]: method: > Apr 12 03:43:21 user devstack@n-api.service[62072]: exception: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: action_args: {'id': '1eef2c91-dfad-43aa-b193-25970db83b79'} Apr 12 03:43:21 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-21ebf780-eb02-47cb-89f6-bab7053ef727 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 404 len: 111 microversion: 2.1 time: 0.033047 Apr 12 03:43:21 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 218/653] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:43:21 2023] DELETE /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 1eef2c91-dfad-43aa-b193-25970db83b79] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:43:21 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 HTTP/1.1 Apr 12 03:43:21 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:43:21 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:43:21 user devstack@n-api.service[62073]: Connection: close Apr 12 03:43:21 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:43:21 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:43:21 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:43:21 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:43:21 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:43:21 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:43:21 user devstack@n-api.service[62073]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:21 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:43:21 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:43:21 user devstack@n-api.service[62073]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:43:21 user devstack@n-api.service[62073]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:43:21 user devstack@n-api.service[62073]: method: > Apr 12 03:43:21 user devstack@n-api.service[62073]: exception: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62073]: action_args: {'id': '1eef2c91-dfad-43aa-b193-25970db83b79'} Apr 12 03:43:21 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. Apr 12 03:43:21 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 1eef2c91-dfad-43aa-b193-25970db83b79 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ccfdae85-4c82-4b2e-977b-d4767dab436b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79" status: 404 len: 111 microversion: 2.1 time: 0.029713 Apr 12 03:43:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 219/654] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:21 2023] GET /compute/v2.1/servers/1eef2c91-dfad-43aa-b193-25970db83b79 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:43:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-159fb1fc-86fe-4df2-902a-c54798896ee5 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: .version_select at 0x7f76a6bea560>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-54080024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASnyncVOhHKPzClYx3zwpDcJrieJkBwHOEHWlg2NFTJJdBa1/TdotUOLxC4yYnCsrHxIQy7r8qgZsehiquLQNSYVTnDsRU6DmQUCbMUYEphptEyPo7yf2/NkfI88nssBw=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:21 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-159fb1fc-86fe-4df2-902a-c54798896ee5 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:43:21 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-159fb1fc-86fe-4df2-902a-c54798896ee5 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:43:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-159fb1fc-86fe-4df2-902a-c54798896ee5 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.050384 Apr 12 03:43:21 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 218/655] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:43:21 2023] POST /compute/v2.1/os-keypairs => generated 398 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:43:21 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b HTTP/1.1 Apr 12 03:43:21 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:43:21 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:43:21 user devstack@n-api.service[62072]: Connection: close Apr 12 03:43:21 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:43:21 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:43:21 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:43:21 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:43:21 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:43:21 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:43:21 user devstack@n-api.service[62072]: method: > Apr 12 03:43:21 user devstack@n-api.service[62072]: exception: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: action_args: {'id': '117ea473-f8e3-43c7-8406-d4590422cc0b'} Apr 12 03:43:21 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:43:21 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-168a3f5a-0b01-412e-a20f-83fd19debbb4 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 404 len: 111 microversion: 2.1 time: 0.028432 Apr 12 03:43:21 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 219/656] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:21 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:43:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9db25593-657c-448c-8495-5741af6945a3 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '.version_select at 0x7f76a6b7b370>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9db25593-657c-448c-8495-5741af6945a3 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-819201420" status: 202 len: 0 microversion: 2.1 time: 0.019511 Apr 12 03:43:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 220/657] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:43:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-819201420 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:22 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lazy-loading 'services' on Instance uuid f73fa883-75f0-4593-a89c-d009c6d4ebf0 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:43:22 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-920e77f7-9355-483d-8258-8aa3e6563163 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments/492e66f2-98d6-43d6-bbe6-cbe61f9335f6" status: 202 len: 0 microversion: 2.1 time: 0.162365 Apr 12 03:43:22 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 219/658] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:43:22 2023] DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments/492e66f2-98d6-43d6-bbe6-cbe61f9335f6 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-60da5080-12d5-410e-9d73-a73e85fe3824 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Apr 12 03:43:22 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 220/659] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:43:22 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:24 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:43:24 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-09412312-e31b-4c99-b552-589337afa498 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab" status: 204 len: 0 microversion: 2.1 time: 0.136560 Apr 12 03:43:24 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 221/660] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:43:24 2023] DELETE /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:25 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45fe6fed1a5a43e5bd0925b92486ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f984af8c7048c7ba68c1530be9cc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-36d1b44c-0bdd-4cc2-9405-2cecbda57140 tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab" status: 200 len: 1491 microversion: 2.1 time: 0.226944 Apr 12 03:43:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 220/661] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:24 2023] GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab => generated 1491 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-549b06ca-3cf2-44ca-80ad-a4e1583ad56d req-6d73bd12-0865-42b9-93ae-7bf7f9e2f3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-unplugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-549b06ca-3cf2-44ca-80ad-a4e1583ad56d req-6d73bd12-0865-42b9-93ae-7bf7f9e2f3d4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-549b06ca-3cf2-44ca-80ad-a4e1583ad56d req-6d73bd12-0865-42b9-93ae-7bf7f9e2f3d4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-549b06ca-3cf2-44ca-80ad-a4e1583ad56d req-6d73bd12-0865-42b9-93ae-7bf7f9e2f3d4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-549b06ca-3cf2-44ca-80ad-a4e1583ad56d req-6d73bd12-0865-42b9-93ae-7bf7f9e2f3d4 service nova] Creating event network-vif-unplugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:43:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-549b06ca-3cf2-44ca-80ad-a4e1583ad56d req-6d73bd12-0865-42b9-93ae-7bf7f9e2f3d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033517 Apr 12 03:43:25 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 221/662] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:25 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-565513575", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-54080024", "security_groups": [{"name": "tempest-secgroup-smoke-376696614"}], "block_device_mapping_v2": [{"uuid": "ac69f59b-6bc4-4f63-bbf6-2952889fcf27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "397a8299-6fbd-4bac-97a1-c8cc31fa2e0e"}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:25 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] validate_networks() for [('397a8299-6fbd-4bac-97a1-c8cc31fa2e0e', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:27 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}, {"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}, {"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}, {"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-plugged", "status": "completed", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}, {"server_uuid": "f88ecf99-d158-4f3c-8a87-6c0322fdc8ab", "name": "network-vif-deleted", "tag": "1c1d30d9-7f27-4302-bccb-f30b9bf2a36f"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:27 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:43:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Creating event network-vif-plugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:43:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Creating event network-vif-plugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:43:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Creating event network-vif-plugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:43:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Creating event network-vif-plugged:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:43:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] Creating event network-vif-deleted:1c1d30d9-7f27-4302-bccb-f30b9bf2a36f for instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab on user Apr 12 03:43:27 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-729aa739-471e-483a-8a14-708934d13118 req-04e084e7-4e9b-4c8d-af3e-4539f7a5ba73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.035686 Apr 12 03:43:27 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 221/663] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:43:27 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac69f59b-6bc4-4f63-bbf6-2952889fcf27',volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:43:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4f9c671c-190f-4d19-a535-2db58727e545 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.980368 Apr 12 03:43:27 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 222/664] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:43:25 2023] POST /compute/v2.1/servers => generated 403 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:43:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-066c29be-e6cc-4a44-92ab-0c09b0d1f9b9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:27 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-066c29be-e6cc-4a44-92ab-0c09b0d1f9b9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:27 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-066c29be-e6cc-4a44-92ab-0c09b0d1f9b9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-066c29be-e6cc-4a44-92ab-0c09b0d1f9b9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 200 len: 1087 microversion: 2.1 time: 0.076558 Apr 12 03:43:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 222/665] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:27 2023] GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:29 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-edbe44e3-0eae-4b1d-892e-ea38f800ee33 req-4d0f897d-5fee-453c-8191-a123a47af26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-edbe44e3-0eae-4b1d-892e-ea38f800ee33 req-4d0f897d-5fee-453c-8191-a123a47af26d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-edbe44e3-0eae-4b1d-892e-ea38f800ee33 req-4d0f897d-5fee-453c-8191-a123a47af26d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-edbe44e3-0eae-4b1d-892e-ea38f800ee33 req-4d0f897d-5fee-453c-8191-a123a47af26d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-edbe44e3-0eae-4b1d-892e-ea38f800ee33 req-4d0f897d-5fee-453c-8191-a123a47af26d service nova] Creating event network-changed:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:43:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-edbe44e3-0eae-4b1d-892e-ea38f800ee33 req-4d0f897d-5fee-453c-8191-a123a47af26d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032041 Apr 12 03:43:30 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "59dbe5d0-117d-453f-a4fa-c324b1b134e0"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:32 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lazy-loading 'flavor' on Instance uuid 614495f2-f108-4759-be60-bc6cc689c5b7 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:43:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a0ed1f44-19dd-4fe9-9f36-3a7f5dd53120 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7/action" status: 200 len: 29 microversion: 2.87 time: 0.394207 Apr 12 03:43:32 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 223/667] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:43:32 2023] POST /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7/action => generated 29 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:32 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-56d7b1dd-fd3d-4cdb-a84f-d13544a18e08 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1775 microversion: 2.87 time: 0.171689 Apr 12 03:43:32 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 223/668] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:43:32 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1775 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:43:33 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-a59ee089-6d09-43ad-b3db-d0c0bc0eced0 req-4e54708d-7dce-4d9b-b8c6-5dee206cd7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-unplugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a59ee089-6d09-43ad-b3db-d0c0bc0eced0 req-4e54708d-7dce-4d9b-b8c6-5dee206cd7a8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a59ee089-6d09-43ad-b3db-d0c0bc0eced0 req-4e54708d-7dce-4d9b-b8c6-5dee206cd7a8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a59ee089-6d09-43ad-b3db-d0c0bc0eced0 req-4e54708d-7dce-4d9b-b8c6-5dee206cd7a8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-a59ee089-6d09-43ad-b3db-d0c0bc0eced0 req-4e54708d-7dce-4d9b-b8c6-5dee206cd7a8 service nova] Creating event network-vif-unplugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:43:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-a59ee089-6d09-43ad-b3db-d0c0bc0eced0 req-4e54708d-7dce-4d9b-b8c6-5dee206cd7a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102898 Apr 12 03:43:33 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 223/669] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-8bb9a64c-d42d-439c-b333-5beeab5570ac req-40b1e2b5-fa6f-4042-90ec-be237ba02107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8bb9a64c-d42d-439c-b333-5beeab5570ac req-40b1e2b5-fa6f-4042-90ec-be237ba02107 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8bb9a64c-d42d-439c-b333-5beeab5570ac req-40b1e2b5-fa6f-4042-90ec-be237ba02107 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-8bb9a64c-d42d-439c-b333-5beeab5570ac req-40b1e2b5-fa6f-4042-90ec-be237ba02107 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-8bb9a64c-d42d-439c-b333-5beeab5570ac req-40b1e2b5-fa6f-4042-90ec-be237ba02107 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:43:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-8bb9a64c-d42d-439c-b333-5beeab5570ac req-40b1e2b5-fa6f-4042-90ec-be237ba02107 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034966 Apr 12 03:43:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 224/670] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-73e6b8c2-a89d-44d4-9802-df9a77279d3a req-6594fd19-d050-422f-91cf-89af0e39dd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "name": "network-vif-plugged", "status": "completed", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-73e6b8c2-a89d-44d4-9802-df9a77279d3a req-6594fd19-d050-422f-91cf-89af0e39dd92 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-73e6b8c2-a89d-44d4-9802-df9a77279d3a req-6594fd19-d050-422f-91cf-89af0e39dd92 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-73e6b8c2-a89d-44d4-9802-df9a77279d3a req-6594fd19-d050-422f-91cf-89af0e39dd92 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-73e6b8c2-a89d-44d4-9802-df9a77279d3a req-6594fd19-d050-422f-91cf-89af0e39dd92 service nova] Creating event network-vif-plugged:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:43:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-73e6b8c2-a89d-44d4-9802-df9a77279d3a req-6594fd19-d050-422f-91cf-89af0e39dd92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045596 Apr 12 03:43:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 224/671] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:43:38 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-334804da-0c67-45fd-a32c-d4aa7cd6c2b5 req-b9a61087-c064-4657-8b61-c663900814f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:38 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-334804da-0c67-45fd-a32c-d4aa7cd6c2b5 req-b9a61087-c064-4657-8b61-c663900814f5 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-334804da-0c67-45fd-a32c-d4aa7cd6c2b5 req-b9a61087-c064-4657-8b61-c663900814f5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-334804da-0c67-45fd-a32c-d4aa7cd6c2b5 req-b9a61087-c064-4657-8b61-c663900814f5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:38 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-334804da-0c67-45fd-a32c-d4aa7cd6c2b5 req-b9a61087-c064-4657-8b61-c663900814f5 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:43:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-334804da-0c67-45fd-a32c-d4aa7cd6c2b5 req-b9a61087-c064-4657-8b61-c663900814f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060785 Apr 12 03:43:38 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 224/672] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:39 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:39 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:39 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-302424f0-57d5-46a8-9fe9-661707ff8bb7 req-3dcca29b-f190-4a34-89b8-7e0428ad20fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "name": "network-vif-plugged", "status": "completed", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-302424f0-57d5-46a8-9fe9-661707ff8bb7 req-3dcca29b-f190-4a34-89b8-7e0428ad20fd service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-302424f0-57d5-46a8-9fe9-661707ff8bb7 req-3dcca29b-f190-4a34-89b8-7e0428ad20fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-302424f0-57d5-46a8-9fe9-661707ff8bb7 req-3dcca29b-f190-4a34-89b8-7e0428ad20fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-302424f0-57d5-46a8-9fe9-661707ff8bb7 req-3dcca29b-f190-4a34-89b8-7e0428ad20fd service nova] Creating event network-vif-plugged:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:43:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-302424f0-57d5-46a8-9fe9-661707ff8bb7 req-3dcca29b-f190-4a34-89b8-7e0428ad20fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Apr 12 03:43:39 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 225/673] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:40 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-3d02715e-aca5-47cb-8013-d3f61c7f2842 req-54d155aa-52c2-4342-aa66-d58edd6a96fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3d02715e-aca5-47cb-8013-d3f61c7f2842 req-54d155aa-52c2-4342-aa66-d58edd6a96fd service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3d02715e-aca5-47cb-8013-d3f61c7f2842 req-54d155aa-52c2-4342-aa66-d58edd6a96fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3d02715e-aca5-47cb-8013-d3f61c7f2842 req-54d155aa-52c2-4342-aa66-d58edd6a96fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-3d02715e-aca5-47cb-8013-d3f61c7f2842 req-54d155aa-52c2-4342-aa66-d58edd6a96fd service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:43:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-3d02715e-aca5-47cb-8013-d3f61c7f2842 req-54d155aa-52c2-4342-aa66-d58edd6a96fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033534 Apr 12 03:43:40 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 225/674] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:52 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:52 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-78ad2526-ad0e-491f-a6de-dae273961121 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.111502 Apr 12 03:43:52 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 225/675] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:43:52 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-interface => generated 283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:53 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:53 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:53 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-bf68c7a4-77f4-48c3-9d3e-9508cdec2a98 req-84247dfa-0fc2-4ff6-972d-4be8b47dca2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bf68c7a4-77f4-48c3-9d3e-9508cdec2a98 req-84247dfa-0fc2-4ff6-972d-4be8b47dca2d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bf68c7a4-77f4-48c3-9d3e-9508cdec2a98 req-84247dfa-0fc2-4ff6-972d-4be8b47dca2d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-bf68c7a4-77f4-48c3-9d3e-9508cdec2a98 req-84247dfa-0fc2-4ff6-972d-4be8b47dca2d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-bf68c7a4-77f4-48c3-9d3e-9508cdec2a98 req-84247dfa-0fc2-4ff6-972d-4be8b47dca2d service nova] Creating event network-changed:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:43:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-bf68c7a4-77f4-48c3-9d3e-9508cdec2a98 req-84247dfa-0fc2-4ff6-972d-4be8b47dca2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041537 Apr 12 03:43:53 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 226/676] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=22 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=24 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-793d220f-8ada-45c1-beae-536843a79ea2 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/ips" status: 200 len: 105 microversion: 2.1 time: 0.039378 Apr 12 03:43:54 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 226/677] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:43:53 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/ips => generated 105 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "188c90f2-90ef-4909-8917-56808fd9a068"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3dbb368b-ed45-43c2-bc6d-6a7844654de0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.307966 Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 226/678] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:43:55 2023] POST /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:55 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:43:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-301e3fff-e2f0-42aa-8fd2-09268e2e8a7d tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1731 microversion: 2.1 time: 0.167694 Apr 12 03:43:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 227/679] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:43:55 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:43:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4cff64a2-b726-4aea-8cf3-0f3e03359101 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276542 Apr 12 03:43:55 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 227/680] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:43:55 2023] POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-unplugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] Creating event network-vif-unplugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:43:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62074) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:43:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-37536abe-1398-48ed-b9c9-ead82a2cec5f req-6427c51d-c3f8-4f99-8418-17bfe3ca6023 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062667 Apr 12 03:43:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] HTTP exception thrown: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Request method failure captured: Apr 12 03:43:58 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 HTTP/1.1 Apr 12 03:43:58 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:43:58 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:43:58 user devstack@n-api.service[62072]: Connection: close Apr 12 03:43:58 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:43:58 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:43:58 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:43:58 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:43:58 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW38GTamOXCQK3iLzQyd9xC8xQx3su8ZJP2KboKP83FRi7ZOWd5CMPGGdF_Hq6lRyWej0-22mpUj-JqUNrIbw_M5ifzJlALH8RTdbeWIO2cMtTbFaiAfDBApf1OoT2ZfG6PE3Qz5SC5LyDPd5y5OCG5ynVr8wVRkHno9F5Ci50vxu8 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Project-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738ebb6b798c4974aa46f9bbe3828279"}]}] Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Tenant-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:43:58 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:43:58 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:43:58 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:43:58 user devstack@n-api.service[62072]: X-User-Id: de1fe5db01624224ab7b615c908d990b Apr 12 03:43:58 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:43:58 user devstack@n-api.service[62072]: method: > Apr 12 03:43:58 user devstack@n-api.service[62072]: exception: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:43:58 user devstack@n-api.service[62072]: action_args: {'id': '06481254-722a-4053-a6af-11f5dcc68636'} Apr 12 03:43:58 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:43:58 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:43:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Returning 404 to user: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:43:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-3b55b621-ad73-4af9-8111-334e0f4a765d tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 404 len: 111 microversion: 2.20 time: 0.032097 Apr 12 03:43:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 228/682] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:43:58 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:43:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6febd5df-d926-41a6-9c53-890a5c7cacea tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '.version_select at 0x7f76a68dce50>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:43:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6febd5df-d926-41a6-9c53-890a5c7cacea tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125155953" status: 204 len: 0 microversion: 2.20 time: 0.023786 Apr 12 03:43:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 228/683] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 03:43:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125155953 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:43:58 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:43:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:43:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:43:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:43:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:43:58 user devstack@n-api.service[62074]: DEBUG nova.compute.api [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62074) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:43:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-5a08fa23-d8c0-40d9-9800-3f4c4f79fd9e req-3baeb5ba-100d-4903-a36e-5a1cc0b4200f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040827 Apr 12 03:43:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 228/684] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] HTTP exception thrown: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Request method failure captured: Apr 12 03:44:01 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 HTTP/1.1 Apr 12 03:44:01 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:44:01 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:44:01 user devstack@n-api.service[62072]: Connection: close Apr 12 03:44:01 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:44:01 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:44:01 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:44:01 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:44:01 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW38GTamOXCQK3iLzQyd9xC8xQx3su8ZJP2KboKP83FRi7ZOWd5CMPGGdF_Hq6lRyWej0-22mpUj-JqUNrIbw_M5ifzJlALH8RTdbeWIO2cMtTbFaiAfDBApf1OoT2ZfG6PE3Qz5SC5LyDPd5y5OCG5ynVr8wVRkHno9F5Ci50vxu8 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Project-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738ebb6b798c4974aa46f9bbe3828279"}]}] Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Tenant-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:01 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:01 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:44:01 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:44:01 user devstack@n-api.service[62072]: X-User-Id: de1fe5db01624224ab7b615c908d990b Apr 12 03:44:01 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:01 user devstack@n-api.service[62072]: method: > Apr 12 03:44:01 user devstack@n-api.service[62072]: exception: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62072]: action_args: {'id': '06481254-722a-4053-a6af-11f5dcc68636'} Apr 12 03:44:01 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Returning 404 to user: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:44:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-cc388d03-9b50-40c2-a2c2-dd23e6cb2d98 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 404 len: 111 microversion: 2.20 time: 0.028070 Apr 12 03:44:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 229/685] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:44:01 2023] DELETE /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: 06481254-722a-4053-a6af-11f5dcc68636] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] HTTP exception thrown: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Request method failure captured: Apr 12 03:44:01 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 HTTP/1.1 Apr 12 03:44:01 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:44:01 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:44:01 user devstack@n-api.service[62073]: Connection: close Apr 12 03:44:01 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:44:01 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:44:01 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:44:01 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:44:01 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW38GTamOXCQK3iLzQyd9xC8xQx3su8ZJP2KboKP83FRi7ZOWd5CMPGGdF_Hq6lRyWej0-22mpUj-JqUNrIbw_M5ifzJlALH8RTdbeWIO2cMtTbFaiAfDBApf1OoT2ZfG6PE3Qz5SC5LyDPd5y5OCG5ynVr8wVRkHno9F5Ci50vxu8 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Project-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738ebb6b798c4974aa46f9bbe3828279"}]}] Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Tenant-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:01 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:01 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:44:01 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:44:01 user devstack@n-api.service[62073]: X-User-Id: de1fe5db01624224ab7b615c908d990b Apr 12 03:44:01 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:01 user devstack@n-api.service[62073]: method: > Apr 12 03:44:01 user devstack@n-api.service[62073]: exception: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62073]: action_args: {'id': '06481254-722a-4053-a6af-11f5dcc68636'} Apr 12 03:44:01 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. Apr 12 03:44:01 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Returning 404 to user: Instance 06481254-722a-4053-a6af-11f5dcc68636 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:44:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-732cc6a7-59ed-46ff-8fc4-f2d98e93ca08 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636" status: 404 len: 111 microversion: 2.20 time: 0.032895 Apr 12 03:44:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 229/686] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:44:01 2023] GET /compute/v2.1/servers/06481254-722a-4053-a6af-11f5dcc68636 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2ee38eec-f7fd-4b9d-afcd-b2b93a73559d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2ee38eec-f7fd-4b9d-afcd-b2b93a73559d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2ee38eec-f7fd-4b9d-afcd-b2b93a73559d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2ee38eec-f7fd-4b9d-afcd-b2b93a73559d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2ee38eec-f7fd-4b9d-afcd-b2b93a73559d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Going to try to stop instance {{(pid=62074) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 03:44:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2ee38eec-f7fd-4b9d-afcd-b2b93a73559d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action" status: 202 len: 0 microversion: 2.1 time: 0.122106 Apr 12 03:44:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 229/687] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:44:03 2023] POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] HTTP exception thrown: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Request method failure captured: Apr 12 03:44:03 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 HTTP/1.1 Apr 12 03:44:03 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:44:03 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:44:03 user devstack@n-api.service[62073]: Connection: close Apr 12 03:44:03 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:44:03 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:44:03 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:44:03 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:44:03 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW38GTamOXCQK3iLzQyd9xC8xQx3su8ZJP2KboKP83FRi7ZOWd5CMPGGdF_Hq6lRyWej0-22mpUj-JqUNrIbw_M5ifzJlALH8RTdbeWIO2cMtTbFaiAfDBApf1OoT2ZfG6PE3Qz5SC5LyDPd5y5OCG5ynVr8wVRkHno9F5Ci50vxu8 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Project-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738ebb6b798c4974aa46f9bbe3828279"}]}] Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Tenant-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:03 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:03 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:44:03 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:44:03 user devstack@n-api.service[62073]: X-User-Id: de1fe5db01624224ab7b615c908d990b Apr 12 03:44:03 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:03 user devstack@n-api.service[62073]: method: > Apr 12 03:44:03 user devstack@n-api.service[62073]: exception: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62073]: action_args: {'id': 'b23d4bcd-989a-45e1-89a3-6e3d30229a32'} Apr 12 03:44:03 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Returning 404 to user: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:44:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c97a8704-70b6-47bc-9c48-0257460ab340 tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 404 len: 111 microversion: 2.20 time: 0.031855 Apr 12 03:44:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 230/688] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:44:03 2023] DELETE /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] [instance: b23d4bcd-989a-45e1-89a3-6e3d30229a32] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] HTTP exception thrown: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Request method failure captured: Apr 12 03:44:03 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 HTTP/1.1 Apr 12 03:44:03 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:44:03 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:44:03 user devstack@n-api.service[62074]: Connection: close Apr 12 03:44:03 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:44:03 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:44:03 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:44:03 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:44:03 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiW38GTamOXCQK3iLzQyd9xC8xQx3su8ZJP2KboKP83FRi7ZOWd5CMPGGdF_Hq6lRyWej0-22mpUj-JqUNrIbw_M5ifzJlALH8RTdbeWIO2cMtTbFaiAfDBApf1OoT2ZfG6PE3Qz5SC5LyDPd5y5OCG5ynVr8wVRkHno9F5Ci50vxu8 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Project-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/738ebb6b798c4974aa46f9bbe3828279"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/738ebb6b798c4974aa46f9bbe3828279"}]}] Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Tenant-Id: 738ebb6b798c4974aa46f9bbe3828279 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2139975165 Apr 12 03:44:03 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:03 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:44:03 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:44:03 user devstack@n-api.service[62074]: X-User-Id: de1fe5db01624224ab7b615c908d990b Apr 12 03:44:03 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2139975165-project-member Apr 12 03:44:03 user devstack@n-api.service[62074]: method: > Apr 12 03:44:03 user devstack@n-api.service[62074]: exception: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62074]: action_args: {'id': 'b23d4bcd-989a-45e1-89a3-6e3d30229a32'} Apr 12 03:44:03 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. Apr 12 03:44:03 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] Returning 404 to user: Instance b23d4bcd-989a-45e1-89a3-6e3d30229a32 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:44:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-09552fcc-39bd-463a-9c70-9074c8c8250a tempest-AttachVolumeShelveTestJSON-2139975165 tempest-AttachVolumeShelveTestJSON-2139975165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32" status: 404 len: 111 microversion: 2.20 time: 0.038701 Apr 12 03:44:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 230/689] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:44:03 2023] GET /compute/v2.1/servers/b23d4bcd-989a-45e1-89a3-6e3d30229a32 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:44:03 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-37490fbb-10db-4f05-b7d2-95ca0cab0a62 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1713 microversion: 2.1 time: 0.186984 Apr 12 03:44:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 230/690] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:44:03 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1713 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9af32e15-52d8-4b90-b87d-3b75ece8cd53 req-8eb5954f-3e3a-43a9-800f-10bb48e30ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-unplugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9af32e15-52d8-4b90-b87d-3b75ece8cd53 req-8eb5954f-3e3a-43a9-800f-10bb48e30ca2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9af32e15-52d8-4b90-b87d-3b75ece8cd53 req-8eb5954f-3e3a-43a9-800f-10bb48e30ca2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9af32e15-52d8-4b90-b87d-3b75ece8cd53 req-8eb5954f-3e3a-43a9-800f-10bb48e30ca2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9af32e15-52d8-4b90-b87d-3b75ece8cd53 req-8eb5954f-3e3a-43a9-800f-10bb48e30ca2 service nova] Creating event network-vif-unplugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:44:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9af32e15-52d8-4b90-b87d-3b75ece8cd53 req-8eb5954f-3e3a-43a9-800f-10bb48e30ca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035322 Apr 12 03:44:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 231/691] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-e83b29e0-201d-4479-8fda-f9f2db80f384 req-f57c2636-f3af-4941-aa72-beac333500e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e83b29e0-201d-4479-8fda-f9f2db80f384 req-f57c2636-f3af-4941-aa72-beac333500e3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e83b29e0-201d-4479-8fda-f9f2db80f384 req-f57c2636-f3af-4941-aa72-beac333500e3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-e83b29e0-201d-4479-8fda-f9f2db80f384 req-f57c2636-f3af-4941-aa72-beac333500e3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-e83b29e0-201d-4479-8fda-f9f2db80f384 req-f57c2636-f3af-4941-aa72-beac333500e3 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:44:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-e83b29e0-201d-4479-8fda-f9f2db80f384 req-f57c2636-f3af-4941-aa72-beac333500e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029934 Apr 12 03:44:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 231/692] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:44:07 user devstack@n-api.service[62072]: DEBUG nova.compute.api [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] Instance 48977eb2-ce43-4577-a1cb-340e35703dbd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:44:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c032f582-2fdc-4c9e-a502-1a79ede17808 req-98c18168-faa4-4d68-999c-5d9080203395 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052526 Apr 12 03:44:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 231/693] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9c2b1316-3e66-457c-9e7b-f998183586d2 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a69c5480>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9c2b1316-3e66-457c-9e7b-f998183586d2 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c78a75-a484-4593-88c9-c62861da59e4" status: 200 len: 351 microversion: 2.1 time: 0.066002 Apr 12 03:44:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 232/694] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:44:09 2023] GET /compute/v2.1/os-volumes/a0c78a75-a484-4593-88c9-c62861da59e4 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-25a66390-af93-4fa5-bf9c-b3a309ccfcf1 req-8facec7e-38c2-4940-aba4-e4a522aa8c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-25a66390-af93-4fa5-bf9c-b3a309ccfcf1 req-8facec7e-38c2-4940-aba4-e4a522aa8c91 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-25a66390-af93-4fa5-bf9c-b3a309ccfcf1 req-8facec7e-38c2-4940-aba4-e4a522aa8c91 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-25a66390-af93-4fa5-bf9c-b3a309ccfcf1 req-8facec7e-38c2-4940-aba4-e4a522aa8c91 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-25a66390-af93-4fa5-bf9c-b3a309ccfcf1 req-8facec7e-38c2-4940-aba4-e4a522aa8c91 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:44:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-25a66390-af93-4fa5-bf9c-b3a309ccfcf1 req-8facec7e-38c2-4940-aba4-e4a522aa8c91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Apr 12 03:44:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 232/695] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9a1e800b-e0b7-4e88-8488-2cdf7b6ba3b5 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a6820d30>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9a1e800b-e0b7-4e88-8488-2cdf7b6ba3b5 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/07a1aa9e-9948-4fa8-adfb-b66c6c435ee7" status: 200 len: 351 microversion: 2.1 time: 0.065575 Apr 12 03:44:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 232/696] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:44:11 2023] GET /compute/v2.1/os-volumes/07a1aa9e-9948-4fa8-adfb-b66c6c435ee7 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:12 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ef7d0766-6426-401c-9f7f-54a64371c957 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a68dfc70>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ef7d0766-6426-401c-9f7f-54a64371c957 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/51540fff-a091-4570-bb3e-c1818cc4ba00" status: 200 len: 350 microversion: 2.1 time: 0.065991 Apr 12 03:44:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 233/697] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:44:12 2023] GET /compute/v2.1/os-volumes/51540fff-a091-4570-bb3e-c1818cc4ba00 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:12 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9dc1f2e1-5fec-471b-a64a-0336a532f2f6 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a6bebf40>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9dc1f2e1-5fec-471b-a64a-0336a532f2f6 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.116724 Apr 12 03:44:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 233/698] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 03:44:12 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:12 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bb7b20a5-f98e-4568-9bf9-39ff5bef820e tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a6b783a0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bb7b20a5-f98e-4568-9bf9-39ff5bef820e tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107726 Apr 12 03:44:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 234/699] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 03:44:12 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:44:12 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-cf8dcd06-4862-4ca7-9178-cc0e5bf47895 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a68b64d0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-ec70338c-ac7d-45f3-b60e-5af74f982e5e tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.282295 Apr 12 03:44:12 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 233/700] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:44:12 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0/os-volume_attachments => generated 25 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:44:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-cf8dcd06-4862-4ca7-9178-cc0e5bf47895 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.146591 Apr 12 03:44:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 234/701] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 03:44:12 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-7f95a3d7-16c0-4596-8635-98859da37c51 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a68dd630>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:44:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-7f95a3d7-16c0-4596-8635-98859da37c51 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096259 Apr 12 03:44:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 235/702] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 03:44:12 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e7890b09-d94a-4565-beec-86e2d2b5b71d tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a68b4ee0>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-45e5ef51-8e5a-418c-9e1a-3f1a988fe6b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 204 len: 0 microversion: 2.1 time: 0.137373 Apr 12 03:44:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 234/703] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:44:13 2023] DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e7890b09-d94a-4565-beec-86e2d2b5b71d tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.100914 Apr 12 03:44:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 235/704] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 03:44:13 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1368c7b6-b8b8-4f64-81c0-c5520bf6dd28 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a68204c0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1368c7b6-b8b8-4f64-81c0-c5520bf6dd28 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.120572 Apr 12 03:44:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 235/705] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 03:44:13 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-807ba669-3af9-42b2-9d57-ae968d2472f6 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 200 len: 1669 microversion: 2.1 time: 0.205313 Apr 12 03:44:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 236/706] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:44:13 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-001abba6-0e93-40a5-9358-ca7a521325f3 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a68b6170>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-001abba6-0e93-40a5-9358-ca7a521325f3 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089462 Apr 12 03:44:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 236/707] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 03:44:13 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-0acc3b29-228a-466b-b9b5-55d832a00b99 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] Calling method '.version_select at 0x7f76a6aa3520>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-05232a6f-e1e5-40b3-aacf-e6ce7fa549a8 req-a8bdcbaf-778c-4ee0-b097-14eb65b84eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "name": "network-vif-unplugged", "status": "completed", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05232a6f-e1e5-40b3-aacf-e6ce7fa549a8 req-a8bdcbaf-778c-4ee0-b097-14eb65b84eee service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05232a6f-e1e5-40b3-aacf-e6ce7fa549a8 req-a8bdcbaf-778c-4ee0-b097-14eb65b84eee service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05232a6f-e1e5-40b3-aacf-e6ce7fa549a8 req-a8bdcbaf-778c-4ee0-b097-14eb65b84eee service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-05232a6f-e1e5-40b3-aacf-e6ce7fa549a8 req-a8bdcbaf-778c-4ee0-b097-14eb65b84eee service nova] Creating event network-vif-unplugged:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:44:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-05232a6f-e1e5-40b3-aacf-e6ce7fa549a8 req-a8bdcbaf-778c-4ee0-b097-14eb65b84eee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034976 Apr 12 03:44:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 237/708] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-0acc3b29-228a-466b-b9b5-55d832a00b99 tempest-VolumesTestJSON-1695259894 tempest-VolumesTestJSON-1695259894-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.101491 Apr 12 03:44:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 03:44:13 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] [instance: f88ecf99-d158-4f3c-8a87-6c0322fdc8ab] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] HTTP exception thrown: Instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab could not be found. Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Request method failure captured: Apr 12 03:44:15 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab HTTP/1.1 Apr 12 03:44:15 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:44:15 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:44:15 user devstack@n-api.service[62074]: Connection: close Apr 12 03:44:15 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:44:15 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:44:15 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:44:15 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:44:15 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNifIySFbf0Mt0gMi-BdCsqxxnEphfgi-v7jCZIJejHEKov6SyYjWVDJxzbHZW6pY70A_W_e7sR3OQIQemGYC9VPO8ZLyqID6cRJzvRd327Zm3L35hL138JZKuaN8cpxKS_yE7dc5_A4bgeiEZNueobQ6J5RijAJYz_bXrQhNCmQCaWo Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Project-Id: f4f984af8c7048c7ba68c1530be9cc8d Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Project-Name: tempest-VolumesActionsTest-629816748 Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4f984af8c7048c7ba68c1530be9cc8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4f984af8c7048c7ba68c1530be9cc8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4f984af8c7048c7ba68c1530be9cc8d"}]}] Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Tenant: tempest-VolumesActionsTest-629816748 Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Tenant-Id: f4f984af8c7048c7ba68c1530be9cc8d Apr 12 03:44:15 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-VolumesActionsTest-629816748 Apr 12 03:44:15 user devstack@n-api.service[62074]: X-User: tempest-VolumesActionsTest-629816748-project-member Apr 12 03:44:15 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:44:15 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:44:15 user devstack@n-api.service[62074]: X-User-Id: 45fe6fed1a5a43e5bd0925b92486ec68 Apr 12 03:44:15 user devstack@n-api.service[62074]: X-User-Name: tempest-VolumesActionsTest-629816748-project-member Apr 12 03:44:15 user devstack@n-api.service[62074]: method: > Apr 12 03:44:15 user devstack@n-api.service[62074]: exception: Instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab could not be found. Apr 12 03:44:15 user devstack@n-api.service[62074]: action_args: {'id': 'f88ecf99-d158-4f3c-8a87-6c0322fdc8ab'} Apr 12 03:44:15 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab could not be found. Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab could not be found. Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab could not be found. Apr 12 03:44:15 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:44:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] Returning 404 to user: Instance f88ecf99-d158-4f3c-8a87-6c0322fdc8ab could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:44:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-68c384c1-e366-4b82-ae71-a5217a5f983b tempest-VolumesActionsTest-629816748 tempest-VolumesActionsTest-629816748-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab" status: 404 len: 111 microversion: 2.1 time: 0.144307 Apr 12 03:44:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:44:15 2023] GET /compute/v2.1/servers/f88ecf99-d158-4f3c-8a87-6c0322fdc8ab => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:44:15 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "name": "network-vif-plugged", "status": "completed", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}, {"server_uuid": "f73fa883-75f0-4593-a89c-d009c6d4ebf0", "name": "network-vif-deleted", "tag": "979f4007-c0b3-408e-9f1c-a62c05af6417"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] Creating event network-vif-plugged:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:44:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] Creating event network-vif-deleted:979f4007-c0b3-408e-9f1c-a62c05af6417 for instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 on user Apr 12 03:44:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-417f1cb7-6cbd-4e4e-8388-2e482f31d6b4 req-9ba0fb8a-0d39-4479-8c50-0eb361c2487c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040498 Apr 12 03:44:15 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 238/711] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1409013015"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:16 user devstack@n-api.service[62072]: INFO nova.network.security_group_api [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Removing security group 1946dd38-3eb4-4fb3-b64f-f1e42a21a6cc from port c904583a-ea96-45c9-ad62-d5e0cc68031f Apr 12 03:44:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1f7bddbf-6d38-4303-8487-d5d141740b79 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/action" status: 202 len: 0 microversion: 2.1 time: 0.584859 Apr 12 03:44:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 237/712] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:44:15 2023] POST /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:44:16 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-61a6588a-7ffe-4d74-a7ac-44ab98b95f95 req-3d094e83-8da3-43a2-88fe-291adb4a63c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-61a6588a-7ffe-4d74-a7ac-44ab98b95f95 req-3d094e83-8da3-43a2-88fe-291adb4a63c7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-61a6588a-7ffe-4d74-a7ac-44ab98b95f95 req-3d094e83-8da3-43a2-88fe-291adb4a63c7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-61a6588a-7ffe-4d74-a7ac-44ab98b95f95 req-3d094e83-8da3-43a2-88fe-291adb4a63c7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:16 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-61a6588a-7ffe-4d74-a7ac-44ab98b95f95 req-3d094e83-8da3-43a2-88fe-291adb4a63c7 service nova] Creating event network-changed:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:44:16 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-61a6588a-7ffe-4d74-a7ac-44ab98b95f95 req-3d094e83-8da3-43a2-88fe-291adb4a63c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028372 Apr 12 03:44:16 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 238/713] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:17 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lazy-loading 'services' on Instance uuid 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:44:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f610b4fd-3b18-4234-bf94-98c54012fcf4 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments/8568ebe9-126e-4516-87a9-cd53c4b520c3" status: 202 len: 0 microversion: 2.1 time: 0.221557 Apr 12 03:44:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 239/714] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:44:17 2023] DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments/8568ebe9-126e-4516-87a9-cd53c4b520c3 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:17 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-126e0309-1811-4cc8-8bdc-5baa16e0bcad tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051738 Apr 12 03:44:17 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 238/715] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:44:17 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:17 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d3600887-bd12-410d-9466-0eb777e7827c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 200 len: 1438 microversion: 2.1 time: 0.242866 Apr 12 03:44:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 239/716] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:44:17 2023] GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 1438 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:18 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-3998ba97-e7e1-4d71-92f4-7254c3476003 req-dce0a49d-94e1-4864-9983-b55e3de2ac52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:44:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3998ba97-e7e1-4d71-92f4-7254c3476003 req-dce0a49d-94e1-4864-9983-b55e3de2ac52 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3998ba97-e7e1-4d71-92f4-7254c3476003 req-dce0a49d-94e1-4864-9983-b55e3de2ac52 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:18 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3998ba97-e7e1-4d71-92f4-7254c3476003 req-dce0a49d-94e1-4864-9983-b55e3de2ac52 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:18 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-3998ba97-e7e1-4d71-92f4-7254c3476003 req-dce0a49d-94e1-4864-9983-b55e3de2ac52 service nova] Creating event network-changed:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:44:18 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-3998ba97-e7e1-4d71-92f4-7254c3476003 req-dce0a49d-94e1-4864-9983-b55e3de2ac52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Apr 12 03:44:18 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 240/717] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:22 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:23 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:23 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-34efac05-51e3-429c-b4d2-d28fb084508c tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1755 microversion: 2.87 time: 0.154898 Apr 12 03:44:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 239/718] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:44:22 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1755 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:45 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:45 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d8e4a8f9-d33c-44fe-80bd-4e34f3b12cbc tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1724 microversion: 2.1 time: 0.230999 Apr 12 03:44:45 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 240/719] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:44:45 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:44:53 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:44:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-e77c8621-e527-44b8-bdd9-1b0d51e857a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1690 microversion: 2.1 time: 0.239889 Apr 12 03:44:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 241/720] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:44:53 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1690 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:45:03 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 HTTP/1.1 Apr 12 03:45:03 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:45:03 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:45:03 user devstack@n-api.service[62072]: Connection: close Apr 12 03:45:03 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:45:03 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:45:03 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:45:03 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:45:03 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:45:03 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:45:03 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:45:03 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:45:03 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:45:03 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:45:03 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:45:03 user devstack@n-api.service[62072]: method: > Apr 12 03:45:03 user devstack@n-api.service[62072]: exception: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:45:03 user devstack@n-api.service[62072]: action_args: {'id': 'f73fa883-75f0-4593-a89c-d009c6d4ebf0'} Apr 12 03:45:03 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:45:03 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:45:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9e42d68c-8cba-4fa2-a6e9-365cb2db8184 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 404 len: 111 microversion: 2.1 time: 0.034718 Apr 12 03:45:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 240/721] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:03 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:45:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-0b70a11b-2f2a-4786-b7e2-76f4ea07858d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '.version_select at 0x7f76a68b6050>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:03 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:03 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-0b70a11b-2f2a-4786-b7e2-76f4ea07858d tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411992271" status: 202 len: 0 microversion: 2.1 time: 0.038098 Apr 12 03:45:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 241/722] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 03:45:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411992271 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:45:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f025ede7-d012-4776-a286-a430b98994da tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: .version_select at 0x7f76a68dc430>, body: {"keypair": {"name": "tempest-keypair-863037271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWW3PcC6A3oaeI+T5mnA66uGmCFTzs3IbsSTkdd3DCArM0rR6yU/WOLMnATsGubN5kt/JcbJyDd6J/OXjO1xRs8Gm7pg5070UpCpDFnH5m0xDJi0dRMwI1KMt4s8ojMvQ=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:04 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-f025ede7-d012-4776-a286-a430b98994da tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:45:04 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-f025ede7-d012-4776-a286-a430b98994da tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:45:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f025ede7-d012-4776-a286-a430b98994da tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047125 Apr 12 03:45:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 242/723] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:45:04 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427168436", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ddbce990-4cfa-40bd-b1e1-fc1531789074"}], "security_groups": [{"name": "tempest-securitygroup--1955458645"}], "key_name": "tempest-keypair-863037271", "user_data": "}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] validate_networks() for [('ddbce990-4cfa-40bd-b1e1-fc1531789074', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:45:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:45:06 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c0e4c593-b1a4-4684-a3f3-5b48fdd77d06 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.644922 Apr 12 03:45:06 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 241/724] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:45:06 2023] POST /compute/v2.1/servers => generated 400 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:45:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bacf3dab-1846-4dbc-8ff4-a611eaee4251 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-bacf3dab-1846-4dbc-8ff4-a611eaee4251 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:06 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-bacf3dab-1846-4dbc-8ff4-a611eaee4251 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-bacf3dab-1846-4dbc-8ff4-a611eaee4251 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 200 len: 1235 microversion: 2.1 time: 0.090339 Apr 12 03:45:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 242/725] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:06 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 1235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0bd97c6b-0564-444f-8274-b489329b4720 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.285079 Apr 12 03:45:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 243/726] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:45:07 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments => generated 25 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] HTTP exception thrown: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 is not attached to volume 8568ebe9-126e-4516-87a9-cd53c4b520c3 Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Request method failure captured: Apr 12 03:45:07 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments/8568ebe9-126e-4516-87a9-cd53c4b520c3 HTTP/1.1 Apr 12 03:45:07 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:45:07 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:45:07 user devstack@n-api.service[62072]: Connection: close Apr 12 03:45:07 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:45:07 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:45:07 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:45:07 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:45:07 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNia2i0SJbnXSsyOiJYY5nvDyeRjF_sl5mAfcPa1VtHIozNVbJZRBZq8JWhH6Zw_bY1Ia6CpLAhVpHPZqzXBnuA6cHQn2g_HAL5bjklnyd4IIZ5Uxmdxd4pf_tbj6hPajirqnXYYJ2tydpw5cnnokaJiE3IkqYCRAfK_kyqqXGDMJb3E Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Project-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/05e1e25933cd42df98fb060b8d2701dc"}]}] Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Tenant: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Tenant-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:45:07 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:45:07 user devstack@n-api.service[62072]: X-User: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:45:07 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:45:07 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:45:07 user devstack@n-api.service[62072]: X-User-Id: 3f8024260bf14d9995e67cb0d1bc8ddc Apr 12 03:45:07 user devstack@n-api.service[62072]: X-User-Name: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:45:07 user devstack@n-api.service[62072]: method: > Apr 12 03:45:07 user devstack@n-api.service[62072]: exception: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 is not attached to volume 8568ebe9-126e-4516-87a9-cd53c4b520c3 Apr 12 03:45:07 user devstack@n-api.service[62072]: action_args: {'server_id': '2d7f71ac-a671-4feb-8c2d-4cbcb84f7170', 'id': '8568ebe9-126e-4516-87a9-cd53c4b520c3'} Apr 12 03:45:07 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8568ebe9-126e-4516-87a9-cd53c4b520c3. Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 is not attached to volume 8568ebe9-126e-4516-87a9-cd53c4b520c3 Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 is not attached to volume 8568ebe9-126e-4516-87a9-cd53c4b520c3 Apr 12 03:45:07 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:45:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Returning 404 to user: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 is not attached to volume 8568ebe9-126e-4516-87a9-cd53c4b520c3 {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:45:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b5ae3aa9-aedb-4ee0-9260-8580ddfe8b3a tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments/8568ebe9-126e-4516-87a9-cd53c4b520c3" status: 404 len: 154 microversion: 2.1 time: 0.164458 Apr 12 03:45:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 242/727] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:45:07 2023] DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170/os-volume_attachments/8568ebe9-126e-4516-87a9-cd53c4b520c3 => generated 154 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:45:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-015c4a09-0690-4fe6-86e8-631b18a8fb98 req-d8a8d894-6b09-48b0-9310-3809ec71cc22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-015c4a09-0690-4fe6-86e8-631b18a8fb98 req-d8a8d894-6b09-48b0-9310-3809ec71cc22 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-015c4a09-0690-4fe6-86e8-631b18a8fb98 req-d8a8d894-6b09-48b0-9310-3809ec71cc22 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-015c4a09-0690-4fe6-86e8-631b18a8fb98 req-d8a8d894-6b09-48b0-9310-3809ec71cc22 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-015c4a09-0690-4fe6-86e8-631b18a8fb98 req-d8a8d894-6b09-48b0-9310-3809ec71cc22 service nova] Creating event network-changed:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:45:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-015c4a09-0690-4fe6-86e8-631b18a8fb98 req-d8a8d894-6b09-48b0-9310-3809ec71cc22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031740 Apr 12 03:45:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 243/728] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:11 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:45:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b7bbd800-b60a-40c0-ac20-bfbb50b37591 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 204 len: 0 microversion: 2.1 time: 0.151508 Apr 12 03:45:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 244/729] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:45:11 2023] DELETE /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1c31f452-aad6-4fd3-a74d-5b7f8fa327a7 req-fd1681b5-2bfd-442a-a2dc-fb20cb12fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "name": "network-vif-plugged", "status": "completed", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:11 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8024260bf14d9995e67cb0d1bc8ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e1e25933cd42df98fb060b8d2701dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1c31f452-aad6-4fd3-a74d-5b7f8fa327a7 req-fd1681b5-2bfd-442a-a2dc-fb20cb12fb78 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1c31f452-aad6-4fd3-a74d-5b7f8fa327a7 req-fd1681b5-2bfd-442a-a2dc-fb20cb12fb78 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:11 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1c31f452-aad6-4fd3-a74d-5b7f8fa327a7 req-fd1681b5-2bfd-442a-a2dc-fb20cb12fb78 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-603e21f3-1d25-4a12-b75f-e94f7575ec1f tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 200 len: 1541 microversion: 2.1 time: 0.182896 Apr 12 03:45:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 243/730] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:11 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 1541 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1c31f452-aad6-4fd3-a74d-5b7f8fa327a7 req-fd1681b5-2bfd-442a-a2dc-fb20cb12fb78 service nova] Creating event network-vif-plugged:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:45:11 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1c31f452-aad6-4fd3-a74d-5b7f8fa327a7 req-fd1681b5-2bfd-442a-a2dc-fb20cb12fb78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056988 Apr 12 03:45:11 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 244/731] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:12 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b982062c-d07f-4195-a099-cd5faac79be4 req-03cb70dd-ef0c-4f4a-a396-dee37205affc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-unplugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b982062c-d07f-4195-a099-cd5faac79be4 req-03cb70dd-ef0c-4f4a-a396-dee37205affc service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b982062c-d07f-4195-a099-cd5faac79be4 req-03cb70dd-ef0c-4f4a-a396-dee37205affc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b982062c-d07f-4195-a099-cd5faac79be4 req-03cb70dd-ef0c-4f4a-a396-dee37205affc service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b982062c-d07f-4195-a099-cd5faac79be4 req-03cb70dd-ef0c-4f4a-a396-dee37205affc service nova] Creating event network-vif-unplugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:45:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b982062c-d07f-4195-a099-cd5faac79be4 req-03cb70dd-ef0c-4f4a-a396-dee37205affc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034499 Apr 12 03:45:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 245/732] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "name": "network-vif-plugged", "status": "completed", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}, {"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-deleted", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] Creating event network-vif-plugged:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:45:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] Creating event network-vif-deleted:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:45:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-01452ac2-38fb-407b-8b1a-ad13541c325c req-36bc0dd0-d5b0-4872-ada3-e64f7d7b0058 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042942 Apr 12 03:45:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 244/733] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:45:14 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-f38a63ff-e678-4fba-8b2d-d889ca0bcff8 req-6e031ed0-8e9f-4097-b7be-9e2d0f7e0efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7f71ac-a671-4feb-8c2d-4cbcb84f7170", "name": "network-vif-plugged", "status": "completed", "tag": "c904583a-ea96-45c9-ad62-d5e0cc68031f"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f38a63ff-e678-4fba-8b2d-d889ca0bcff8 req-6e031ed0-8e9f-4097-b7be-9e2d0f7e0efa service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f38a63ff-e678-4fba-8b2d-d889ca0bcff8 req-6e031ed0-8e9f-4097-b7be-9e2d0f7e0efa service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f38a63ff-e678-4fba-8b2d-d889ca0bcff8 req-6e031ed0-8e9f-4097-b7be-9e2d0f7e0efa service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f38a63ff-e678-4fba-8b2d-d889ca0bcff8 req-6e031ed0-8e9f-4097-b7be-9e2d0f7e0efa service nova] Creating event network-vif-plugged:c904583a-ea96-45c9-ad62-d5e0cc68031f for instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 on user Apr 12 03:45:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-f38a63ff-e678-4fba-8b2d-d889ca0bcff8 req-6e031ed0-8e9f-4097-b7be-9e2d0f7e0efa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041429 Apr 12 03:45:14 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 245/734] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:17 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:18 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:18 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-13f027ad-7f1b-4463-9c38-ebf147aa5dbf tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 200 len: 1438 microversion: 2.1 time: 0.379565 Apr 12 03:45:18 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 246/735] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:17 2023] GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 1438 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:20 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:20 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-a6b8d93b-c3eb-4858-aacc-801d85cb7dc3 req-6ae99ad9-5209-4c01-b466-712fc9c6455a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a6b8d93b-c3eb-4858-aacc-801d85cb7dc3 req-6ae99ad9-5209-4c01-b466-712fc9c6455a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a6b8d93b-c3eb-4858-aacc-801d85cb7dc3 req-6ae99ad9-5209-4c01-b466-712fc9c6455a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a6b8d93b-c3eb-4858-aacc-801d85cb7dc3 req-6ae99ad9-5209-4c01-b466-712fc9c6455a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a6b8d93b-c3eb-4858-aacc-801d85cb7dc3 req-6ae99ad9-5209-4c01-b466-712fc9c6455a service nova] Creating event network-changed:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:45:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-a6b8d93b-c3eb-4858-aacc-801d85cb7dc3 req-6ae99ad9-5209-4c01-b466-712fc9c6455a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040120 Apr 12 03:45:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 245/736] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:20 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:45:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-517fea11-011b-485f-8fd7-6ddb69d397cb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 204 len: 0 microversion: 2.1 time: 0.269906 Apr 12 03:45:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 246/737] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:45:20 2023] DELETE /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:21 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3201d3f3-de88-4269-89cd-fee9f7abca75 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 200 len: 1444 microversion: 2.1 time: 0.418477 Apr 12 03:45:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 247/738] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:20 2023] GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 1444 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:22 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "name": "network-vif-unplugged", "status": "completed", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}, {"server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "name": "network-vif-plugged", "status": "completed", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] Creating event network-vif-unplugged:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:45:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] Creating event network-vif-plugged:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:45:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-2c3a7a8a-b307-4cde-9d26-2c0f98dda402 req-fbf436a7-b57c-4426-a570-10c5f1189609 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035868 Apr 12 03:45:22 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 246/739] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-621e9f3c-515f-4893-bfc1-ea3f92cd9ed7 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "POST /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7/action" status: 202 len: 0 microversion: 2.87 time: 0.089916 Apr 12 03:45:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 247/740] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 03:45:23 2023] POST /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:23 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8a511d8e-e5f5-455e-b14e-dd6f571e39bd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1763 microversion: 2.87 time: 0.381867 Apr 12 03:45:23 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 248/741] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:45:23 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1763 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:45:24 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-7cf3b245-98d9-43bd-9fad-758ceca79fb3 req-04a4e66b-7621-409a-88f6-01dae8f04733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e45116-bb5c-40ca-9fc5-1c5c40ff687e", "name": "network-vif-deleted", "tag": "e210f496-084e-443f-9c7f-684661441f6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7cf3b245-98d9-43bd-9fad-758ceca79fb3 req-04a4e66b-7621-409a-88f6-01dae8f04733 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7cf3b245-98d9-43bd-9fad-758ceca79fb3 req-04a4e66b-7621-409a-88f6-01dae8f04733 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-7cf3b245-98d9-43bd-9fad-758ceca79fb3 req-04a4e66b-7621-409a-88f6-01dae8f04733 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-7cf3b245-98d9-43bd-9fad-758ceca79fb3 req-04a4e66b-7621-409a-88f6-01dae8f04733 service nova] Creating event network-vif-deleted:e210f496-084e-443f-9c7f-684661441f6c for instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e on user Apr 12 03:45:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-7cf3b245-98d9-43bd-9fad-758ceca79fb3 req-04a4e66b-7621-409a-88f6-01dae8f04733 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121680 Apr 12 03:45:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 247/742] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:25 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-dd060dba-1504-4dc0-a7bf-70626637661a req-0164eadf-6532-4195-b049-840be8742c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-unplugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd060dba-1504-4dc0-a7bf-70626637661a req-0164eadf-6532-4195-b049-840be8742c48 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd060dba-1504-4dc0-a7bf-70626637661a req-0164eadf-6532-4195-b049-840be8742c48 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd060dba-1504-4dc0-a7bf-70626637661a req-0164eadf-6532-4195-b049-840be8742c48 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-dd060dba-1504-4dc0-a7bf-70626637661a req-0164eadf-6532-4195-b049-840be8742c48 service nova] Creating event network-vif-unplugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:45:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-dd060dba-1504-4dc0-a7bf-70626637661a req-0164eadf-6532-4195-b049-840be8742c48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132880 Apr 12 03:45:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 248/743] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:45:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}, {"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}, {"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:45:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:45:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:45:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7182a920-ca27-4fd2-b4ef-4a293815b89d req-97ba58d0-319d-41f5-a7a4-81d21c6e7953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030564 Apr 12 03:45:27 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 249/744] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:27 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-62e8f88a-bf2e-42b2-b5f6-a71cb93c9ec5 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Action: 'create', calling method: .version_select at 0x7f76a6731630>, body: {"keypair": {"name": "tempest-TestStampPattern-474439147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxviRdZviloE/Y8vy1de4Nl8WuqpnNhf4wG8IpFYt8u0P1qgKwJzMzVj8wiWWgzOhRDflg4OM3oRDBzEH9LU9bTdJCvVUrt7G9IZqwugvdWPxD2R1lvN0sxiTneX8pngQ=="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:27 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-62e8f88a-bf2e-42b2-b5f6-a71cb93c9ec5 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Getting quotas for project c426e52304c14ed9b0c1aed69691bc3d. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:45:27 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-62e8f88a-bf2e-42b2-b5f6-a71cb93c9ec5 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Getting quotas for user 88c496d8e488434e833e67df25def576 and project c426e52304c14ed9b0c1aed69691bc3d. Resources: {'key_pairs'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:45:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-62e8f88a-bf2e-42b2-b5f6-a71cb93c9ec5 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.141505 Apr 12 03:45:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 248/745] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:45:27 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1815563360", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "key_name": "tempest-TestStampPattern-474439147", "security_groups": [{"name": "tempest-secgroup-smoke-1602438667"}], "networks": [{"uuid": "8ef5a542-2a86-44d7-9ec3-dbce4cd3af6a"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:30 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] validate_networks() for [('8ef5a542-2a86-44d7-9ec3-dbce4cd3af6a', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Getting quotas for project c426e52304c14ed9b0c1aed69691bc3d. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Getting quotas for user 88c496d8e488434e833e67df25def576 and project c426e52304c14ed9b0c1aed69691bc3d. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:45:31 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:45:31 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-62971632-69bc-46d5-a2aa-8d78583c202e tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.768795 Apr 12 03:45:31 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 249/746] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:45:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:45:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-53ba4a87-b5e2-4975-bdc9-f8c82dda7393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-53ba4a87-b5e2-4975-bdc9-f8c82dda7393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:31 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-53ba4a87-b5e2-4975-bdc9-f8c82dda7393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-53ba4a87-b5e2-4975-bdc9-f8c82dda7393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed" status: 200 len: 1236 microversion: 2.1 time: 0.066924 Apr 12 03:45:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 250/747] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:31 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-11293f69-9d92-4aa0-8485-99b5ac9b6519 req-cf045d71-8c12-4551-8805-702624fa28a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:34 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-11293f69-9d92-4aa0-8485-99b5ac9b6519 req-cf045d71-8c12-4551-8805-702624fa28a4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-11293f69-9d92-4aa0-8485-99b5ac9b6519 req-cf045d71-8c12-4551-8805-702624fa28a4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-11293f69-9d92-4aa0-8485-99b5ac9b6519 req-cf045d71-8c12-4551-8805-702624fa28a4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:34 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=25 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-11293f69-9d92-4aa0-8485-99b5ac9b6519 req-cf045d71-8c12-4551-8805-702624fa28a4 service nova] Creating event network-changed:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:45:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-11293f69-9d92-4aa0-8485-99b5ac9b6519 req-cf045d71-8c12-4551-8805-702624fa28a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202368 Apr 12 03:45:34 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 249/748] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:36 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1f9e5059-95c6-4243-9e3d-54fa2c0dae1f req-df1c3a77-cee4-460a-a5c8-c0a532a8aaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "name": "network-vif-plugged", "status": "completed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:36 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1f9e5059-95c6-4243-9e3d-54fa2c0dae1f req-df1c3a77-cee4-460a-a5c8-c0a532a8aaea service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1f9e5059-95c6-4243-9e3d-54fa2c0dae1f req-df1c3a77-cee4-460a-a5c8-c0a532a8aaea service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1f9e5059-95c6-4243-9e3d-54fa2c0dae1f req-df1c3a77-cee4-460a-a5c8-c0a532a8aaea service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:36 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:36 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1f9e5059-95c6-4243-9e3d-54fa2c0dae1f req-df1c3a77-cee4-460a-a5c8-c0a532a8aaea service nova] Creating event network-vif-plugged:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:45:36 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1f9e5059-95c6-4243-9e3d-54fa2c0dae1f req-df1c3a77-cee4-460a-a5c8-c0a532a8aaea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041770 Apr 12 03:45:36 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 250/749] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:45:38 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-27d02620-661a-4295-964e-c033f0f6d18c req-9a385f83-9fde-430d-a67f-b22cf859da6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "name": "network-vif-plugged", "status": "completed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:38 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:38 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-27d02620-661a-4295-964e-c033f0f6d18c req-9a385f83-9fde-430d-a67f-b22cf859da6c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-27d02620-661a-4295-964e-c033f0f6d18c req-9a385f83-9fde-430d-a67f-b22cf859da6c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-27d02620-661a-4295-964e-c033f0f6d18c req-9a385f83-9fde-430d-a67f-b22cf859da6c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-27d02620-661a-4295-964e-c033f0f6d18c req-9a385f83-9fde-430d-a67f-b22cf859da6c service nova] Creating event network-vif-plugged:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:45:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-27d02620-661a-4295-964e-c033f0f6d18c req-9a385f83-9fde-430d-a67f-b22cf859da6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037425 Apr 12 03:45:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 251/750] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:46 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-db1a3283-d5ca-49ff-813c-42f13774f02a tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1724 microversion: 2.1 time: 0.307352 Apr 12 03:45:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 250/751] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:46 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:46 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f5442cd5-1c9e-48e3-b3db-48bbcc0a55b8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1724 microversion: 2.1 time: 0.153214 Apr 12 03:45:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 251/752] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:46 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-74104a0f-044c-4918-ba9a-7bb3fbf0c507 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-74104a0f-044c-4918-ba9a-7bb3fbf0c507 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-74104a0f-044c-4918-ba9a-7bb3fbf0c507 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-74104a0f-044c-4918-ba9a-7bb3fbf0c507 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:54 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-74104a0f-044c-4918-ba9a-7bb3fbf0c507 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Going to try to start instance {{(pid=62073) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 03:45:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-74104a0f-044c-4918-ba9a-7bb3fbf0c507 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action" status: 202 len: 0 microversion: 2.1 time: 0.111858 Apr 12 03:45:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 252/753] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:45:54 2023] POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:54 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-20f10794-c472-401a-a4f2-4b83753f9626 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1699 microversion: 2.1 time: 0.150456 Apr 12 03:45:54 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 251/754] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:54 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=7 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:56 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:45:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-dcccaedc-fdec-4b78-be9a-03ec467b5324 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 200 len: 1546 microversion: 2.1 time: 0.170851 Apr 12 03:45:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 252/755] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:45:56 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:45:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-05baf7db-8c51-4227-b069-25d7de4cab6a req-f3b36553-e3af-430f-823f-10f20f170cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:45:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05baf7db-8c51-4227-b069-25d7de4cab6a req-f3b36553-e3af-430f-823f-10f20f170cfe service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:45:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05baf7db-8c51-4227-b069-25d7de4cab6a req-f3b36553-e3af-430f-823f-10f20f170cfe service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:45:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-05baf7db-8c51-4227-b069-25d7de4cab6a req-f3b36553-e3af-430f-823f-10f20f170cfe service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:45:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-05baf7db-8c51-4227-b069-25d7de4cab6a req-f3b36553-e3af-430f-823f-10f20f170cfe service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:45:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-05baf7db-8c51-4227-b069-25d7de4cab6a req-f3b36553-e3af-430f-823f-10f20f170cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046878 Apr 12 03:45:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 253/756] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-0df2cf4a-f23f-4124-8b26-92215363b682 req-1aee33d2-51ed-449e-8314-a43ab1c211f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0df2cf4a-f23f-4124-8b26-92215363b682 req-1aee33d2-51ed-449e-8314-a43ab1c211f7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0df2cf4a-f23f-4124-8b26-92215363b682 req-1aee33d2-51ed-449e-8314-a43ab1c211f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0df2cf4a-f23f-4124-8b26-92215363b682 req-1aee33d2-51ed-449e-8314-a43ab1c211f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-0df2cf4a-f23f-4124-8b26-92215363b682 req-1aee33d2-51ed-449e-8314-a43ab1c211f7 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:46:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-0df2cf4a-f23f-4124-8b26-92215363b682 req-1aee33d2-51ed-449e-8314-a43ab1c211f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288536 Apr 12 03:46:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 252/757] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] [instance: 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] HTTP exception thrown: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 could not be found. Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Request method failure captured: Apr 12 03:46:01 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 HTTP/1.1 Apr 12 03:46:01 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:46:01 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:46:01 user devstack@n-api.service[62074]: Connection: close Apr 12 03:46:01 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:46:01 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:46:01 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:46:01 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:46:01 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNia2i0SJbnXSsyOiJYY5nvDyeRjF_sl5mAfcPa1VtHIozNVbJZRBZq8JWhH6Zw_bY1Ia6CpLAhVpHPZqzXBnuA6cHQn2g_HAL5bjklnyd4IIZ5Uxmdxd4pf_tbj6hPajirqnXYYJ2tydpw5cnnokaJiE3IkqYCRAfK_kyqqXGDMJb3E Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Project-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05e1e25933cd42df98fb060b8d2701dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/05e1e25933cd42df98fb060b8d2701dc"}]}] Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Tenant: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Tenant-Id: 05e1e25933cd42df98fb060b8d2701dc Apr 12 03:46:01 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1605347971 Apr 12 03:46:01 user devstack@n-api.service[62074]: X-User: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:46:01 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:46:01 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:46:01 user devstack@n-api.service[62074]: X-User-Id: 3f8024260bf14d9995e67cb0d1bc8ddc Apr 12 03:46:01 user devstack@n-api.service[62074]: X-User-Name: tempest-TestMinimumBasicScenario-1605347971-project-member Apr 12 03:46:01 user devstack@n-api.service[62074]: method: > Apr 12 03:46:01 user devstack@n-api.service[62074]: exception: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 could not be found. Apr 12 03:46:01 user devstack@n-api.service[62074]: action_args: {'id': '2d7f71ac-a671-4feb-8c2d-4cbcb84f7170'} Apr 12 03:46:01 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 could not be found. Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 could not be found. Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 could not be found. Apr 12 03:46:01 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:46:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Returning 404 to user: Instance 2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:46:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4c1cb5d7-4f00-4c6f-bdde-eb31897ab5b0 tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170" status: 404 len: 111 microversion: 2.1 time: 0.033943 Apr 12 03:46:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 253/758] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:46:01 2023] GET /compute/v2.1/servers/2d7f71ac-a671-4feb-8c2d-4cbcb84f7170 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:46:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-58091e91-0275-4b07-a1d4-30467597210b tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] Calling method '.version_select at 0x7f76a68dfd90>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-58091e91-0275-4b07-a1d4-30467597210b tempest-TestMinimumBasicScenario-1605347971 tempest-TestMinimumBasicScenario-1605347971-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1199406481" status: 202 len: 0 microversion: 2.1 time: 0.026433 Apr 12 03:46:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 254/759] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 03:46:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1199406481 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=7 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=15 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:46:11 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e HTTP/1.1 Apr 12 03:46:11 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:46:11 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:46:11 user devstack@n-api.service[62072]: Connection: close Apr 12 03:46:11 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:46:11 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:46:11 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:46:11 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:46:11 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:46:11 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:46:11 user devstack@n-api.service[62072]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:46:11 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:46:11 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:46:11 user devstack@n-api.service[62072]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:46:11 user devstack@n-api.service[62072]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:46:11 user devstack@n-api.service[62072]: method: > Apr 12 03:46:11 user devstack@n-api.service[62072]: exception: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:46:11 user devstack@n-api.service[62072]: action_args: {'id': '93e45116-bb5c-40ca-9fc5-1c5c40ff687e'} Apr 12 03:46:11 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:46:11 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:46:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:46:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4850d00e-de65-455b-bf04-74718321de58 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 404 len: 111 microversion: 2.1 time: 0.288027 Apr 12 03:46:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 253/760] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:46:11 2023] GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:46:11 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1526891958", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-54080024", "security_groups": [{"name": "tempest-secgroup-smoke-376696614"}], "block_device_mapping_v2": [{"uuid": "ac69f59b-6bc4-4f63-bbf6-2952889fcf27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "397a8299-6fbd-4bac-97a1-c8cc31fa2e0e"}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:11 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:11 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:11 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] validate_networks() for [('397a8299-6fbd-4bac-97a1-c8cc31fa2e0e', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:46:12 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac69f59b-6bc4-4f63-bbf6-2952889fcf27',volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:46:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ed85b1cb-2d6f-4c13-8b1c-af31e76add19 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.900275 Apr 12 03:46:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 254/761] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:46:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:46:12 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:12 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:12 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0aaee52f-9a0b-4f6a-b6ce-086c325bebc2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:12 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0aaee52f-9a0b-4f6a-b6ce-086c325bebc2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:12 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-0aaee52f-9a0b-4f6a-b6ce-086c325bebc2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0aaee52f-9a0b-4f6a-b6ce-086c325bebc2 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef" status: 200 len: 1088 microversion: 2.1 time: 0.093456 Apr 12 03:46:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 255/762] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:46:12 2023] GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef => generated 1088 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:13 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-11b6dac7-a5b7-4670-985e-59cece8efc46 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1769 microversion: 2.87 time: 0.158285 Apr 12 03:46:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 254/763] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:46:13 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1769 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:46:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-505e405c-ac38-466f-883b-c61e7297ceb4 req-f9d5c9a9-cd08-4035-9108-ba1e8102132f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-505e405c-ac38-466f-883b-c61e7297ceb4 req-f9d5c9a9-cd08-4035-9108-ba1e8102132f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-505e405c-ac38-466f-883b-c61e7297ceb4 req-f9d5c9a9-cd08-4035-9108-ba1e8102132f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-505e405c-ac38-466f-883b-c61e7297ceb4 req-f9d5c9a9-cd08-4035-9108-ba1e8102132f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-505e405c-ac38-466f-883b-c61e7297ceb4 req-f9d5c9a9-cd08-4035-9108-ba1e8102132f service nova] Creating event network-changed:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:46:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-505e405c-ac38-466f-883b-c61e7297ceb4 req-f9d5c9a9-cd08-4035-9108-ba1e8102132f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036293 Apr 12 03:46:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 255/764] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:21 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-784946ce-4a63-4cb5-8c0e-92aa0d6b278d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed" status: 200 len: 1537 microversion: 2.1 time: 0.178011 Apr 12 03:46:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 256/765] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:46:21 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:46:21 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-db957f91-23c4-4066-840b-5de9f7c3cfc3 req-b886d851-8af0-4577-9153-ab1121c74558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "name": "network-vif-plugged", "status": "completed", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-db957f91-23c4-4066-840b-5de9f7c3cfc3 req-b886d851-8af0-4577-9153-ab1121c74558 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-db957f91-23c4-4066-840b-5de9f7c3cfc3 req-b886d851-8af0-4577-9153-ab1121c74558 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:21 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-db957f91-23c4-4066-840b-5de9f7c3cfc3 req-b886d851-8af0-4577-9153-ab1121c74558 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-db957f91-23c4-4066-840b-5de9f7c3cfc3 req-b886d851-8af0-4577-9153-ab1121c74558 service nova] Creating event network-vif-plugged:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:46:21 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-db957f91-23c4-4066-840b-5de9f7c3cfc3 req-b886d851-8af0-4577-9153-ab1121c74558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029597 Apr 12 03:46:21 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 255/766] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:23 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:23 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:23 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-05412171-2b7b-4db9-9206-68f6a060c0ba req-f2ec5664-769c-4813-b7bf-8b736dae000a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "name": "network-vif-plugged", "status": "completed", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-05412171-2b7b-4db9-9206-68f6a060c0ba req-f2ec5664-769c-4813-b7bf-8b736dae000a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-05412171-2b7b-4db9-9206-68f6a060c0ba req-f2ec5664-769c-4813-b7bf-8b736dae000a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-05412171-2b7b-4db9-9206-68f6a060c0ba req-f2ec5664-769c-4813-b7bf-8b736dae000a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-05412171-2b7b-4db9-9206-68f6a060c0ba req-f2ec5664-769c-4813-b7bf-8b736dae000a service nova] Creating event network-vif-plugged:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:46:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-05412171-2b7b-4db9-9206-68f6a060c0ba req-f2ec5664-769c-4813-b7bf-8b736dae000a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036799 Apr 12 03:46:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 256/767] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:44 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-007c196e-19ae-416c-b740-bf794fbe05f7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1703 microversion: 2.1 time: 0.150082 Apr 12 03:46:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 257/768] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:46:44 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1703 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=10 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:46 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:46:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-10312cdd-3c4f-4aa1-9ada-eecab11a4063 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 204 len: 0 microversion: 2.1 time: 0.130522 Apr 12 03:46:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 256/769] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:46:46 2023] DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:46 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:46:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-5116105a-4e7a-46fd-8f2d-2dfd524d6289 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 200 len: 1730 microversion: 2.1 time: 0.225172 Apr 12 03:46:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 257/770] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:46:46 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:46:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-eeb53517-9441-4ad3-9fa3-02c0939dd433 req-770f19ef-833a-4b27-8f60-b42177c64a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-unplugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-eeb53517-9441-4ad3-9fa3-02c0939dd433 req-770f19ef-833a-4b27-8f60-b42177c64a7e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-eeb53517-9441-4ad3-9fa3-02c0939dd433 req-770f19ef-833a-4b27-8f60-b42177c64a7e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-eeb53517-9441-4ad3-9fa3-02c0939dd433 req-770f19ef-833a-4b27-8f60-b42177c64a7e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-eeb53517-9441-4ad3-9fa3-02c0939dd433 req-770f19ef-833a-4b27-8f60-b42177c64a7e service nova] Creating event network-vif-unplugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:46:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-eeb53517-9441-4ad3-9fa3-02c0939dd433 req-770f19ef-833a-4b27-8f60-b42177c64a7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029670 Apr 12 03:46:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 258/771] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:48 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-85422d02-1cdf-482b-b50d-57646e11457f req-3e36be5f-dc45-44ab-b4e0-8f403677c523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-deleted", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:48 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-85422d02-1cdf-482b-b50d-57646e11457f req-3e36be5f-dc45-44ab-b4e0-8f403677c523 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:48 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-85422d02-1cdf-482b-b50d-57646e11457f req-3e36be5f-dc45-44ab-b4e0-8f403677c523 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:48 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-85422d02-1cdf-482b-b50d-57646e11457f req-3e36be5f-dc45-44ab-b4e0-8f403677c523 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:48 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-85422d02-1cdf-482b-b50d-57646e11457f req-3e36be5f-dc45-44ab-b4e0-8f403677c523 service nova] Creating event network-vif-deleted:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:46:48 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-85422d02-1cdf-482b-b50d-57646e11457f req-3e36be5f-dc45-44ab-b4e0-8f403677c523 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Apr 12 03:46:48 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 257/772] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-bbf4e3a8-2cef-4899-9fce-f74cbf9645d1 req-78423c9b-c22d-4eee-9734-22ecd1cc7c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48977eb2-ce43-4577-a1cb-340e35703dbd", "name": "network-vif-plugged", "status": "completed", "tag": "18f9f68c-eadd-4582-8f16-b88a13496852"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bbf4e3a8-2cef-4899-9fce-f74cbf9645d1 req-78423c9b-c22d-4eee-9734-22ecd1cc7c33 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bbf4e3a8-2cef-4899-9fce-f74cbf9645d1 req-78423c9b-c22d-4eee-9734-22ecd1cc7c33 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bbf4e3a8-2cef-4899-9fce-f74cbf9645d1 req-78423c9b-c22d-4eee-9734-22ecd1cc7c33 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-bbf4e3a8-2cef-4899-9fce-f74cbf9645d1 req-78423c9b-c22d-4eee-9734-22ecd1cc7c33 service nova] Creating event network-vif-plugged:18f9f68c-eadd-4582-8f16-b88a13496852 for instance 48977eb2-ce43-4577-a1cb-340e35703dbd on user Apr 12 03:46:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-bbf4e3a8-2cef-4899-9fce-f74cbf9645d1 req-78423c9b-c22d-4eee-9734-22ecd1cc7c33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Apr 12 03:46:49 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 258/773] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=8 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ebefbd10-4560-4820-9830-71c79377cbfa tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.109781 Apr 12 03:46:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 259/774] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:46:57 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-3bef051e-2a65-4828-9e81-7f37bf52cabf req-06ca1f7d-add7-48e1-870e-12acc03c03f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3bef051e-2a65-4828-9e81-7f37bf52cabf req-06ca1f7d-add7-48e1-870e-12acc03c03f4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3bef051e-2a65-4828-9e81-7f37bf52cabf req-06ca1f7d-add7-48e1-870e-12acc03c03f4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3bef051e-2a65-4828-9e81-7f37bf52cabf req-06ca1f7d-add7-48e1-870e-12acc03c03f4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-3bef051e-2a65-4828-9e81-7f37bf52cabf req-06ca1f7d-add7-48e1-870e-12acc03c03f4 service nova] Creating event network-changed:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:46:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-3bef051e-2a65-4828-9e81-7f37bf52cabf req-06ca1f7d-add7-48e1-870e-12acc03c03f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034368 Apr 12 03:46:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 258/775] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-32ae0641-943d-4ee4-be99-75817245fd44 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/ips" status: 200 len: 109 microversion: 2.1 time: 0.108379 Apr 12 03:46:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 259/776] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:46:58 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/ips => generated 109 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27f03268-3b13-4460-a92b-9de6d6f63d8e"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:46:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:46:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-be037fe2-7b9e-45c1-aa23-c6d28c4cbed7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270842 Apr 12 03:46:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 260/777] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:46:59 2023] POST /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:02 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-59dcb932-26f6-4412-8d63-92b360ffa2f9 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef" status: 200 len: 1440 microversion: 2.1 time: 0.165876 Apr 12 03:47:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 259/778] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:02 2023] GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef => generated 1440 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27f03268-3b13-4460-a92b-9de6d6f63d8e"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Invalid volume: volume 27f03268-3b13-4460-a92b-9de6d6f63d8e is already attached to instances: a264f3f7-b0ea-482a-a438-909f06a80726 Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:47:06 user devstack@n-api.service[62074]: request: POST /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments HTTP/1.1 Apr 12 03:47:06 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:47:06 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:47:06 user devstack@n-api.service[62074]: Connection: close Apr 12 03:47:06 user devstack@n-api.service[62074]: Content-Length: 74 Apr 12 03:47:06 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:47:06 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:47:06 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:47:06 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:47:06 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:47:06 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:47:06 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:47:06 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:47:06 user devstack@n-api.service[62074]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:47:06 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:47:06 user devstack@n-api.service[62074]: Apr 12 03:47:06 user devstack@n-api.service[62074]: {"volumeAttachment": {"volumeId": "27f03268-3b13-4460-a92b-9de6d6f63d8e"}} Apr 12 03:47:06 user devstack@n-api.service[62074]: method: > Apr 12 03:47:06 user devstack@n-api.service[62074]: exception: Invalid volume: volume 27f03268-3b13-4460-a92b-9de6d6f63d8e is already attached to instances: a264f3f7-b0ea-482a-a438-909f06a80726 Apr 12 03:47:06 user devstack@n-api.service[62074]: action_args: {'server_id': 'a264f3f7-b0ea-482a-a438-909f06a80726', 'body': {'volumeAttachment': {'volumeId': '27f03268-3b13-4460-a92b-9de6d6f63d8e'}}} Apr 12 03:47:06 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27f03268-3b13-4460-a92b-9de6d6f63d8e is already attached to instances: a264f3f7-b0ea-482a-a438-909f06a80726 Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27f03268-3b13-4460-a92b-9de6d6f63d8e is already attached to instances: a264f3f7-b0ea-482a-a438-909f06a80726 Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27f03268-3b13-4460-a92b-9de6d6f63d8e is already attached to instances: a264f3f7-b0ea-482a-a438-909f06a80726 Apr 12 03:47:06 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 400 to user: Invalid volume: volume 27f03268-3b13-4460-a92b-9de6d6f63d8e is already attached to instances: a264f3f7-b0ea-482a-a438-909f06a80726 {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:47:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3e7d2599-c739-4376-a646-e6b17b9fc6e0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123888 Apr 12 03:47:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 260/779] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:47:06 2023] POST /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:06 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lazy-loading 'services' on Instance uuid a264f3f7-b0ea-482a-a438-909f06a80726 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:47:06 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-2d658e96-c6d5-4daa-b094-674415537bfd tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments/27f03268-3b13-4460-a92b-9de6d6f63d8e" status: 202 len: 0 microversion: 2.1 time: 0.152549 Apr 12 03:47:06 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 261/780] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:47:06 2023] DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments/27f03268-3b13-4460-a92b-9de6d6f63d8e => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:06 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-3db1b07e-adf4-4629-a127-5bcb681713ff tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069740 Apr 12 03:47:06 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 260/781] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:47:06 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:13 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:14 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:47:14 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2987552d-130d-4ca1-b89d-28e40d748ee3 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 204 len: 0 microversion: 2.87 time: 0.219486 Apr 12 03:47:14 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 261/782] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:47:13 2023] DELETE /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:14 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-07aff617-75f1-42d7-b08b-4fdcfc16b532 req-693f2e13-2bb5-4c3f-a786-4f0e038272c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-unplugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-07aff617-75f1-42d7-b08b-4fdcfc16b532 req-693f2e13-2bb5-4c3f-a786-4f0e038272c5 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-07aff617-75f1-42d7-b08b-4fdcfc16b532 req-693f2e13-2bb5-4c3f-a786-4f0e038272c5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-07aff617-75f1-42d7-b08b-4fdcfc16b532 req-693f2e13-2bb5-4c3f-a786-4f0e038272c5 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:14 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-07aff617-75f1-42d7-b08b-4fdcfc16b532 req-693f2e13-2bb5-4c3f-a786-4f0e038272c5 service nova] Creating event network-vif-unplugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:47:14 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-07aff617-75f1-42d7-b08b-4fdcfc16b532 req-693f2e13-2bb5-4c3f-a786-4f0e038272c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040247 Apr 12 03:47:14 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 261/783] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:14 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:14 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-63dbda43-44b8-4cfb-800f-984523b44357 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 200 len: 1775 microversion: 2.87 time: 0.268910 Apr 12 03:47:14 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 262/784] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:47:14 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 1775 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:47:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c04e8c98-9c50-4ba3-94b1-f07f9956c958 req-737776f2-353d-425f-bf0e-df8cdd7c41db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-deleted", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c04e8c98-9c50-4ba3-94b1-f07f9956c958 req-737776f2-353d-425f-bf0e-df8cdd7c41db service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c04e8c98-9c50-4ba3-94b1-f07f9956c958 req-737776f2-353d-425f-bf0e-df8cdd7c41db service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c04e8c98-9c50-4ba3-94b1-f07f9956c958 req-737776f2-353d-425f-bf0e-df8cdd7c41db service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c04e8c98-9c50-4ba3-94b1-f07f9956c958 req-737776f2-353d-425f-bf0e-df8cdd7c41db service nova] Creating event network-vif-deleted:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:47:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c04e8c98-9c50-4ba3-94b1-f07f9956c958 req-737776f2-353d-425f-bf0e-df8cdd7c41db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Apr 12 03:47:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 262/785] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-993d2bc9-1e51-4fdf-9531-d9b04805af8a req-3a91773a-0cb4-404a-b289-63676ccbed19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614495f2-f108-4759-be60-bc6cc689c5b7", "name": "network-vif-plugged", "status": "completed", "tag": "b9acaee6-a684-4827-bc91-1c6219782efe"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-993d2bc9-1e51-4fdf-9531-d9b04805af8a req-3a91773a-0cb4-404a-b289-63676ccbed19 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-993d2bc9-1e51-4fdf-9531-d9b04805af8a req-3a91773a-0cb4-404a-b289-63676ccbed19 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-993d2bc9-1e51-4fdf-9531-d9b04805af8a req-3a91773a-0cb4-404a-b289-63676ccbed19 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-993d2bc9-1e51-4fdf-9531-d9b04805af8a req-3a91773a-0cb4-404a-b289-63676ccbed19 service nova] Creating event network-vif-plugged:b9acaee6-a684-4827-bc91-1c6219782efe for instance 614495f2-f108-4759-be60-bc6cc689c5b7 on user Apr 12 03:47:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-993d2bc9-1e51-4fdf-9531-d9b04805af8a req-3a91773a-0cb4-404a-b289-63676ccbed19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Apr 12 03:47:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 262/786] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:21 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-578ecef4-d2d2-4bc8-b671-758c6bdaefe7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed" status: 200 len: 1537 microversion: 2.1 time: 0.158115 Apr 12 03:47:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 263/787] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:21 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:47:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3811ff7a-3d4b-4ead-909c-37cdfedc2a1d req-470931f3-35f2-4d1f-8197-02cacc82530c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:24 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3811ff7a-3d4b-4ead-909c-37cdfedc2a1d req-470931f3-35f2-4d1f-8197-02cacc82530c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3811ff7a-3d4b-4ead-909c-37cdfedc2a1d req-470931f3-35f2-4d1f-8197-02cacc82530c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3811ff7a-3d4b-4ead-909c-37cdfedc2a1d req-470931f3-35f2-4d1f-8197-02cacc82530c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:24 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3811ff7a-3d4b-4ead-909c-37cdfedc2a1d req-470931f3-35f2-4d1f-8197-02cacc82530c service nova] Creating event network-changed:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:47:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3811ff7a-3d4b-4ead-909c-37cdfedc2a1d req-470931f3-35f2-4d1f-8197-02cacc82530c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130945 Apr 12 03:47:24 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 263/788] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce7f211d-d195-4fd9-936a-eb3ce8c33470"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:24 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-3ce42a08-5165-47af-94cc-74737dfc40bc tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468904 Apr 12 03:47:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 263/789] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:47:24 2023] POST /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:32 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lazy-loading 'services' on Instance uuid 7c2344ea-3ed4-40f5-b318-6fa8588b1fed {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:47:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c45cdc09-027b-49e4-a87b-804fb968313f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments/ce7f211d-d195-4fd9-936a-eb3ce8c33470" status: 202 len: 0 microversion: 2.1 time: 0.197400 Apr 12 03:47:32 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 264/790] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:47:32 2023] DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments/ce7f211d-d195-4fd9-936a-eb3ce8c33470 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:32 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4d4c58dc-864f-4470-9817-bda33dad7c68 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Apr 12 03:47:32 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 264/791] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:47:32 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:36 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:47:37 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd HTTP/1.1 Apr 12 03:47:37 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:47:37 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:47:37 user devstack@n-api.service[62072]: Connection: close Apr 12 03:47:37 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:47:37 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:47:37 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:47:37 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:47:37 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:47:37 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62072]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:47:37 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:47:37 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:47:37 user devstack@n-api.service[62072]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:47:37 user devstack@n-api.service[62072]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:47:37 user devstack@n-api.service[62072]: method: > Apr 12 03:47:37 user devstack@n-api.service[62072]: exception: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62072]: action_args: {'id': '48977eb2-ce43-4577-a1cb-340e35703dbd'} Apr 12 03:47:37 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:47:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1e9ca403-20c3-4cce-8f5e-3de6042e9cd1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 404 len: 111 microversion: 2.1 time: 0.064499 Apr 12 03:47:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 264/792] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:36 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:47:37 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments HTTP/1.1 Apr 12 03:47:37 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:47:37 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:47:37 user devstack@n-api.service[62073]: Connection: close Apr 12 03:47:37 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:47:37 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:47:37 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:47:37 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:47:37 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:47:37 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62073]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:47:37 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:47:37 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:47:37 user devstack@n-api.service[62073]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:47:37 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:47:37 user devstack@n-api.service[62073]: method: > Apr 12 03:47:37 user devstack@n-api.service[62073]: exception: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62073]: action_args: {'server_id': '48977eb2-ce43-4577-a1cb-340e35703dbd'} Apr 12 03:47:37 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:47:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3f912a8f-a3ce-451c-98d1-07e462a4fcdd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032893 Apr 12 03:47:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 265/793] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:47:37 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:47:37 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd HTTP/1.1 Apr 12 03:47:37 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:47:37 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:47:37 user devstack@n-api.service[62074]: Connection: close Apr 12 03:47:37 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:47:37 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:47:37 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:47:37 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:47:37 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:47:37 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:47:37 user devstack@n-api.service[62074]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:47:37 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:47:37 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:47:37 user devstack@n-api.service[62074]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:47:37 user devstack@n-api.service[62074]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:47:37 user devstack@n-api.service[62074]: method: > Apr 12 03:47:37 user devstack@n-api.service[62074]: exception: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62074]: action_args: {'id': '48977eb2-ce43-4577-a1cb-340e35703dbd'} Apr 12 03:47:37 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:47:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:47:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:47:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-189d333f-d19b-4d2d-9993-ade47eb228c1 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 404 len: 111 microversion: 2.1 time: 0.028719 Apr 12 03:47:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 265/794] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:37 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1485022675", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "9cac7f86-c0da-4b81-bdde-50662f79d265"}], "security_groups": [{"name": "tempest-securitygroup--1184528712"}], "key_name": "tempest-keypair-364276420", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] validate_networks() for [('9cac7f86-c0da-4b81-bdde-50662f79d265', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:47:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:47:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f7f74d21-ca34-4f47-9e7a-c25ccda6f681 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.564789 Apr 12 03:47:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 265/795] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:47:37 2023] POST /compute/v2.1/servers => generated 404 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ec02a716-3219-4a4b-8b0b-0007b9d5af58 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ec02a716-3219-4a4b-8b0b-0007b9d5af58 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:38 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-ec02a716-3219-4a4b-8b0b-0007b9d5af58 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ec02a716-3219-4a4b-8b0b-0007b9d5af58 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13" status: 200 len: 1232 microversion: 2.1 time: 0.065042 Apr 12 03:47:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 266/796] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:37 2023] GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 => generated 1232 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:47:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-67892a7d-9e65-4e48-9832-3c57ae4ac7d1 req-c8bc6b48-7ae8-44c7-9aff-c7a18819c7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-67892a7d-9e65-4e48-9832-3c57ae4ac7d1 req-c8bc6b48-7ae8-44c7-9aff-c7a18819c7ed service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-67892a7d-9e65-4e48-9832-3c57ae4ac7d1 req-c8bc6b48-7ae8-44c7-9aff-c7a18819c7ed service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:40 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-67892a7d-9e65-4e48-9832-3c57ae4ac7d1 req-c8bc6b48-7ae8-44c7-9aff-c7a18819c7ed service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-67892a7d-9e65-4e48-9832-3c57ae4ac7d1 req-c8bc6b48-7ae8-44c7-9aff-c7a18819c7ed service nova] Creating event network-changed:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:47:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-67892a7d-9e65-4e48-9832-3c57ae4ac7d1 req-c8bc6b48-7ae8-44c7-9aff-c7a18819c7ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040301 Apr 12 03:47:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 266/797] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-8ef9d16d-c553-495a-8f0b-e909dbd3561d req-18a5d985-2754-4f2f-a63e-69f924e8c574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "name": "network-vif-plugged", "status": "completed", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8ef9d16d-c553-495a-8f0b-e909dbd3561d req-18a5d985-2754-4f2f-a63e-69f924e8c574 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8ef9d16d-c553-495a-8f0b-e909dbd3561d req-18a5d985-2754-4f2f-a63e-69f924e8c574 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-8ef9d16d-c553-495a-8f0b-e909dbd3561d req-18a5d985-2754-4f2f-a63e-69f924e8c574 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-8ef9d16d-c553-495a-8f0b-e909dbd3561d req-18a5d985-2754-4f2f-a63e-69f924e8c574 service nova] Creating event network-vif-plugged:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:47:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-8ef9d16d-c553-495a-8f0b-e909dbd3561d req-18a5d985-2754-4f2f-a63e-69f924e8c574 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047765 Apr 12 03:47:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 266/798] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-ce206dd1-8df8-4ffc-882e-9a4b4efe9c38 req-02f8f60a-f2b1-4220-8605-fb7360a8c046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "name": "network-vif-plugged", "status": "completed", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ce206dd1-8df8-4ffc-882e-9a4b4efe9c38 req-02f8f60a-f2b1-4220-8605-fb7360a8c046 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ce206dd1-8df8-4ffc-882e-9a4b4efe9c38 req-02f8f60a-f2b1-4220-8605-fb7360a8c046 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ce206dd1-8df8-4ffc-882e-9a4b4efe9c38 req-02f8f60a-f2b1-4220-8605-fb7360a8c046 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ce206dd1-8df8-4ffc-882e-9a4b4efe9c38 req-02f8f60a-f2b1-4220-8605-fb7360a8c046 service nova] Creating event network-vif-plugged:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:47:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-ce206dd1-8df8-4ffc-882e-9a4b4efe9c38 req-02f8f60a-f2b1-4220-8605-fb7360a8c046 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029776 Apr 12 03:47:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 267/799] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:44 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lazy-loading 'services' on Instance uuid 606425bb-8968-41f9-b3a5-80b6fd188a67 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:47:45 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-412b0092-81f5-4a77-a76e-60d2309c3743 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-volume_attachments/188c90f2-90ef-4909-8917-56808fd9a068" status: 202 len: 0 microversion: 2.1 time: 0.285718 Apr 12 03:47:45 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 267/800] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:47:44 2023] DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-volume_attachments/188c90f2-90ef-4909-8917-56808fd9a068 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:47:47 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f2e202f0-e149-465f-b021-dea70d131532 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f2e202f0-e149-465f-b021-dea70d131532 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f2e202f0-e149-465f-b021-dea70d131532 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f2e202f0-e149-465f-b021-dea70d131532 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:47 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f2e202f0-e149-465f-b021-dea70d131532 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Going to try to stop instance {{(pid=62072) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 03:47:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f2e202f0-e149-465f-b021-dea70d131532 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action" status: 202 len: 0 microversion: 2.1 time: 0.125372 Apr 12 03:47:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 267/801] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:47:47 2023] POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:47 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9fe5bc79-aecf-49ef-9d37-138e99770537 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1667 microversion: 2.1 time: 0.207418 Apr 12 03:47:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 268/802] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:47 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1667 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:47:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-dd3f6330-227f-4226-b80a-a0e081c25625 req-5cde1505-ba22-4d43-be22-1d5eea95c6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-unplugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd3f6330-227f-4226-b80a-a0e081c25625 req-5cde1505-ba22-4d43-be22-1d5eea95c6fd service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd3f6330-227f-4226-b80a-a0e081c25625 req-5cde1505-ba22-4d43-be22-1d5eea95c6fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd3f6330-227f-4226-b80a-a0e081c25625 req-5cde1505-ba22-4d43-be22-1d5eea95c6fd service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-dd3f6330-227f-4226-b80a-a0e081c25625 req-5cde1505-ba22-4d43-be22-1d5eea95c6fd service nova] Creating event network-vif-unplugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:47:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-dd3f6330-227f-4226-b80a-a0e081c25625 req-5cde1505-ba22-4d43-be22-1d5eea95c6fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030836 Apr 12 03:47:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 268/803] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:49 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:49 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-unplugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:47:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:47:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:47:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Creating event network-vif-unplugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:47:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:47:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-961d6cc8-c68b-4204-93d3-66683043f8cc req-2416816f-439a-4387-a39e-e6dbf8af47ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.038664 Apr 12 03:47:49 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 268/804] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:49 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8d213def-fe0d-4fc9-b0b1-11a78ff80e05 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.287630 Apr 12 03:47:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 269/805] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:47:56 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726/os-volume_attachments => generated 25 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=12 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:57 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:47:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-b4b8a209-9059-45f8-a68a-65404b470faf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 204 len: 0 microversion: 2.1 time: 0.125670 Apr 12 03:47:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 269/806] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:47:57 2023] DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:57 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:47:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-fd978d1a-6ec6-4deb-b02f-9275235ab6ab tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 200 len: 1671 microversion: 2.1 time: 0.176380 Apr 12 03:47:57 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 269/807] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:47:57 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:47:57 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-34d0c65b-0795-4532-b443-cfd6446f40fc req-de06af69-a6b4-4a1b-a571-f46ea556d5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "name": "network-vif-unplugged", "status": "completed", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-34d0c65b-0795-4532-b443-cfd6446f40fc req-de06af69-a6b4-4a1b-a571-f46ea556d5da service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-34d0c65b-0795-4532-b443-cfd6446f40fc req-de06af69-a6b4-4a1b-a571-f46ea556d5da service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:57 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-34d0c65b-0795-4532-b443-cfd6446f40fc req-de06af69-a6b4-4a1b-a571-f46ea556d5da service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-34d0c65b-0795-4532-b443-cfd6446f40fc req-de06af69-a6b4-4a1b-a571-f46ea556d5da service nova] Creating event network-vif-unplugged:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:47:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-34d0c65b-0795-4532-b443-cfd6446f40fc req-de06af69-a6b4-4a1b-a571-f46ea556d5da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030080 Apr 12 03:47:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 270/808] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:47:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "name": "network-vif-plugged", "status": "completed", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}, {"server_uuid": "a264f3f7-b0ea-482a-a438-909f06a80726", "name": "network-vif-deleted", "tag": "e294fdef-5e1a-47fd-bcb1-08b22b4941b0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:47:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:47:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:47:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:47:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] Creating event network-vif-plugged:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:47:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] Creating event network-vif-deleted:e294fdef-5e1a-47fd-bcb1-08b22b4941b0 for instance a264f3f7-b0ea-482a-a438-909f06a80726 on user Apr 12 03:47:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-0fca9a74-333e-4efd-b8d0-3e2e07f669c8 req-1676a8fe-11e1-406b-bc4b-32ef47be3ef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029075 Apr 12 03:47:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 270/809] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:03 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-2d01ec7e-4b5c-4c3a-92ff-32fcc6e938e7 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef" status: 200 len: 1440 microversion: 2.1 time: 0.148376 Apr 12 03:48:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 270/810] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:03 2023] GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef => generated 1440 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 614495f2-f108-4759-be60-bc6cc689c5b7] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=17 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] HTTP exception thrown: Instance 614495f2-f108-4759-be60-bc6cc689c5b7 could not be found. Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Request method failure captured: Apr 12 03:48:04 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 HTTP/1.1 Apr 12 03:48:04 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:48:04 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:48:04 user devstack@n-api.service[62073]: Connection: close Apr 12 03:48:04 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:48:04 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:48:04 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:48:04 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:48:04 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW-_la1gw9Bw6zk3QykH9snh1esnPKBes2Z08Pk7xZchcypR_3FlBR3q48seWPDZF4gOuYE0LKHeqMUW2pOX5KTGwFJ_uuJd3h2fs5ye9rN2EmlHf8UzSNtO-jlK0EXW5r46nYNbaR7nNDyEvT6xGZ-vwykNOIQq2kcIVYbUfxPMUs Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Project-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e1fa352a8c144a1aada7ce0d8818429"}]}] Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Tenant-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:48:04 user devstack@n-api.service[62073]: X-User: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:48:04 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:48:04 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:48:04 user devstack@n-api.service[62073]: X-User-Id: d99be569057f432484e4a60b46882bbd Apr 12 03:48:04 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:48:04 user devstack@n-api.service[62073]: method: > Apr 12 03:48:04 user devstack@n-api.service[62073]: exception: Instance 614495f2-f108-4759-be60-bc6cc689c5b7 could not be found. Apr 12 03:48:04 user devstack@n-api.service[62073]: action_args: {'id': '614495f2-f108-4759-be60-bc6cc689c5b7'} Apr 12 03:48:04 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614495f2-f108-4759-be60-bc6cc689c5b7 could not be found. Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614495f2-f108-4759-be60-bc6cc689c5b7 could not be found. Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614495f2-f108-4759-be60-bc6cc689c5b7 could not be found. Apr 12 03:48:04 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Returning 404 to user: Instance 614495f2-f108-4759-be60-bc6cc689c5b7 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:48:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b116cba0-ce24-470e-abbf-515573e36bcc tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7" status: 404 len: 111 microversion: 2.87 time: 0.036767 Apr 12 03:48:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 271/811] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:48:04 2023] GET /compute/v2.1/servers/614495f2-f108-4759-be60-bc6cc689c5b7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:04 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:48:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-be21f625-d1c0-4206-bf5a-5e24614f1b78 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8" status: 204 len: 0 microversion: 2.87 time: 0.113914 Apr 12 03:48:04 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 271/812] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:48:04 2023] DELETE /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-c2990030-c6f0-449a-b73c-36bbe1ad4278 req-3e7d7e9d-ecfa-4835-ada2-c1d533bbde2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c2990030-c6f0-449a-b73c-36bbe1ad4278 req-3e7d7e9d-ecfa-4835-ada2-c1d533bbde2c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c2990030-c6f0-449a-b73c-36bbe1ad4278 req-3e7d7e9d-ecfa-4835-ada2-c1d533bbde2c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c2990030-c6f0-449a-b73c-36bbe1ad4278 req-3e7d7e9d-ecfa-4835-ada2-c1d533bbde2c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c2990030-c6f0-449a-b73c-36bbe1ad4278 req-3e7d7e9d-ecfa-4835-ada2-c1d533bbde2c service nova] Creating event network-changed:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:48:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-c2990030-c6f0-449a-b73c-36bbe1ad4278 req-3e7d7e9d-ecfa-4835-ada2-c1d533bbde2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030732 Apr 12 03:48:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 272/813] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:05 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:05 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:05 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1bb63d8a-5a6b-40a3-90da-2202e04654cd tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8" status: 200 len: 1697 microversion: 2.87 time: 0.237427 Apr 12 03:48:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 271/814] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:48:04 2023] GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 => generated 1697 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:48:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-cbc0e0b4-40b8-4655-9f43-99c45781f4e7 req-b9e409d7-d5ce-4e09-8f03-76b7d04f1c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4407f4-e078-4777-a110-cb3f922be2e8", "name": "network-vif-unplugged", "status": "completed", "tag": "aec6d617-eb2b-42b3-8cce-f21de7c1b91c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cbc0e0b4-40b8-4655-9f43-99c45781f4e7 req-b9e409d7-d5ce-4e09-8f03-76b7d04f1c9a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cbc0e0b4-40b8-4655-9f43-99c45781f4e7 req-b9e409d7-d5ce-4e09-8f03-76b7d04f1c9a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-cbc0e0b4-40b8-4655-9f43-99c45781f4e7 req-b9e409d7-d5ce-4e09-8f03-76b7d04f1c9a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-cbc0e0b4-40b8-4655-9f43-99c45781f4e7 req-b9e409d7-d5ce-4e09-8f03-76b7d04f1c9a service nova] Creating event network-vif-unplugged:aec6d617-eb2b-42b3-8cce-f21de7c1b91c for instance 3d4407f4-e078-4777-a110-cb3f922be2e8 on user Apr 12 03:48:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-cbc0e0b4-40b8-4655-9f43-99c45781f4e7 req-b9e409d7-d5ce-4e09-8f03-76b7d04f1c9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040513 Apr 12 03:48:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 272/815] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4407f4-e078-4777-a110-cb3f922be2e8", "name": "network-vif-plugged", "status": "completed", "tag": "aec6d617-eb2b-42b3-8cce-f21de7c1b91c"}, {"server_uuid": "3d4407f4-e078-4777-a110-cb3f922be2e8", "name": "network-vif-deleted", "tag": "aec6d617-eb2b-42b3-8cce-f21de7c1b91c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] Creating event network-vif-plugged:aec6d617-eb2b-42b3-8cce-f21de7c1b91c for instance 3d4407f4-e078-4777-a110-cb3f922be2e8 on user Apr 12 03:48:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] Creating event network-vif-deleted:aec6d617-eb2b-42b3-8cce-f21de7c1b91c for instance 3d4407f4-e078-4777-a110-cb3f922be2e8 on user Apr 12 03:48:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-b9343280-d718-4e98-b21e-966d65d4e81a req-1c4b127a-8f63-4777-99ae-d55016520070 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038961 Apr 12 03:48:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 273/816] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-682928462", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-54080024", "security_groups": [{"name": "tempest-secgroup-smoke-376696614"}], "block_device_mapping_v2": [{"uuid": "b27d5f9c-2ca3-4c1d-86b8-9af733bddd76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "397a8299-6fbd-4bac-97a1-c8cc31fa2e0e"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:08 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] validate_networks() for [('397a8299-6fbd-4bac-97a1-c8cc31fa2e0e', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Getting quotas for user b00b348933224558aad1cb12921f100f and project 003688353e2f4b36831c574ebaf65173. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:48:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b27d5f9c-2ca3-4c1d-86b8-9af733bddd76',volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:48:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-672a0050-4d11-49f6-a16b-e8d0129781d1 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.719746 Apr 12 03:48:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 272/817] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:48:08 2023] POST /compute/v2.1/servers => generated 403 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:48:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e667c975-c137-4d30-9094-f8addd00f6fb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:09 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e667c975-c137-4d30-9094-f8addd00f6fb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:09 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-e667c975-c137-4d30-9094-f8addd00f6fb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e667c975-c137-4d30-9094-f8addd00f6fb tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873" status: 200 len: 1087 microversion: 2.1 time: 0.077214 Apr 12 03:48:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 273/818] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:09 2023] GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:48:12 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-c652e50b-0ad9-4361-aa7e-06f2cda1f154 req-d821c51c-027c-480c-a5b2-79864341e490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c652e50b-0ad9-4361-aa7e-06f2cda1f154 req-d821c51c-027c-480c-a5b2-79864341e490 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c652e50b-0ad9-4361-aa7e-06f2cda1f154 req-d821c51c-027c-480c-a5b2-79864341e490 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:12 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c652e50b-0ad9-4361-aa7e-06f2cda1f154 req-d821c51c-027c-480c-a5b2-79864341e490 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c652e50b-0ad9-4361-aa7e-06f2cda1f154 req-d821c51c-027c-480c-a5b2-79864341e490 service nova] Creating event network-changed:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:48:12 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-c652e50b-0ad9-4361-aa7e-06f2cda1f154 req-d821c51c-027c-480c-a5b2-79864341e490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032380 Apr 12 03:48:12 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 274/819] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:48:18 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-6de1938a-53cb-4729-8cf4-3aae79f70f8f req-1bd84cc2-448b-452c-a7fb-f5293c0b589b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "name": "network-vif-plugged", "status": "completed", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:18 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6de1938a-53cb-4729-8cf4-3aae79f70f8f req-1bd84cc2-448b-452c-a7fb-f5293c0b589b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:18 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6de1938a-53cb-4729-8cf4-3aae79f70f8f req-1bd84cc2-448b-452c-a7fb-f5293c0b589b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:18 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6de1938a-53cb-4729-8cf4-3aae79f70f8f req-1bd84cc2-448b-452c-a7fb-f5293c0b589b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:18 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-6de1938a-53cb-4729-8cf4-3aae79f70f8f req-1bd84cc2-448b-452c-a7fb-f5293c0b589b service nova] Creating event network-vif-plugged:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:48:18 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-6de1938a-53cb-4729-8cf4-3aae79f70f8f req-1bd84cc2-448b-452c-a7fb-f5293c0b589b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Apr 12 03:48:18 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 273/820] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1ae3ac70-ea7f-499a-948d-58f7b299bb8c req-4359036e-93b1-44eb-bbdf-50a0dc7cde06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "name": "network-vif-plugged", "status": "completed", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1ae3ac70-ea7f-499a-948d-58f7b299bb8c req-4359036e-93b1-44eb-bbdf-50a0dc7cde06 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1ae3ac70-ea7f-499a-948d-58f7b299bb8c req-4359036e-93b1-44eb-bbdf-50a0dc7cde06 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1ae3ac70-ea7f-499a-948d-58f7b299bb8c req-4359036e-93b1-44eb-bbdf-50a0dc7cde06 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1ae3ac70-ea7f-499a-948d-58f7b299bb8c req-4359036e-93b1-44eb-bbdf-50a0dc7cde06 service nova] Creating event network-vif-plugged:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:48:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1ae3ac70-ea7f-499a-948d-58f7b299bb8c req-4359036e-93b1-44eb-bbdf-50a0dc7cde06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047276 Apr 12 03:48:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 274/821] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=7 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=7 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:22 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6f58480e-2ed6-4450-b11a-2397b4410620 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052028 Apr 12 03:48:22 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 275/822] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:48:22 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1998485426"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e4f10acb-86dc-47d5-909f-8fe0b8fa2753 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/action" status: 202 len: 0 microversion: 2.1 time: 1.200606 Apr 12 03:48:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 274/823] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:48:23 2023] POST /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/action => generated 0 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:28 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ba9835d0-e87b-4a34-93a9-afe722b4cbe7 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13" status: 200 len: 1540 microversion: 2.1 time: 0.182800 Apr 12 03:48:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 275/824] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:28 2023] GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 => generated 1540 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:48:32 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-2010836582", "imageRef": "e36d7fe2-0f9a-43e7-9565-714b8a727ea5", "flavorRef": "42", "key_name": "tempest-TestStampPattern-474439147", "security_groups": [{"name": "tempest-secgroup-smoke-1602438667"}], "networks": [{"uuid": "8ef5a542-2a86-44d7-9ec3-dbce4cd3af6a"}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:32 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:32 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:32 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] validate_networks() for [('8ef5a542-2a86-44d7-9ec3-dbce4cd3af6a', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Getting quotas for project c426e52304c14ed9b0c1aed69691bc3d. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Getting quotas for user 88c496d8e488434e833e67df25def576 and project c426e52304c14ed9b0c1aed69691bc3d. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:48:33 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e36d7fe2-0f9a-43e7-9565-714b8a727ea5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:48:33 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b08c399d-6c6d-4b7f-a109-e6604ee1e877 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.605271 Apr 12 03:48:33 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 276/825] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:48:32 2023] POST /compute/v2.1/servers => generated 404 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:48:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-37dd258c-97e6-4e82-b714-ba140aa4892b tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:33 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-37dd258c-97e6-4e82-b714-ba140aa4892b tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:33 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-37dd258c-97e6-4e82-b714-ba140aa4892b tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-37dd258c-97e6-4e82-b714-ba140aa4892b tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076" status: 200 len: 1236 microversion: 2.1 time: 0.077661 Apr 12 03:48:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 275/826] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:33 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:48:36 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-09ec884f-7808-4a16-8011-ab2f4fe195ac req-9651587c-1d4e-4def-bf8e-aa68f8ae6b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-09ec884f-7808-4a16-8011-ab2f4fe195ac req-9651587c-1d4e-4def-bf8e-aa68f8ae6b28 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-09ec884f-7808-4a16-8011-ab2f4fe195ac req-9651587c-1d4e-4def-bf8e-aa68f8ae6b28 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-09ec884f-7808-4a16-8011-ab2f4fe195ac req-9651587c-1d4e-4def-bf8e-aa68f8ae6b28 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-09ec884f-7808-4a16-8011-ab2f4fe195ac req-9651587c-1d4e-4def-bf8e-aa68f8ae6b28 service nova] Creating event network-changed:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:48:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-09ec884f-7808-4a16-8011-ab2f4fe195ac req-9651587c-1d4e-4def-bf8e-aa68f8ae6b28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028584 Apr 12 03:48:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 276/827] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:37 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f06cf9f0-5a89-4815-8482-990c017735a3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1644 microversion: 2.1 time: 0.150737 Apr 12 03:48:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 277/828] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:37 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1644 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:48:38 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-b3fba22c-abe6-46ed-8ca4-3e222cf1ec31 req-a412431a-b096-4f9e-a46f-7d0811d70bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "name": "network-vif-plugged", "status": "completed", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:38 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:38 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b3fba22c-abe6-46ed-8ca4-3e222cf1ec31 req-a412431a-b096-4f9e-a46f-7d0811d70bb7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b3fba22c-abe6-46ed-8ca4-3e222cf1ec31 req-a412431a-b096-4f9e-a46f-7d0811d70bb7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:38 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-b3fba22c-abe6-46ed-8ca4-3e222cf1ec31 req-a412431a-b096-4f9e-a46f-7d0811d70bb7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-b3fba22c-abe6-46ed-8ca4-3e222cf1ec31 req-a412431a-b096-4f9e-a46f-7d0811d70bb7 service nova] Creating event network-vif-plugged:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:48:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-b3fba22c-abe6-46ed-8ca4-3e222cf1ec31 req-a412431a-b096-4f9e-a46f-7d0811d70bb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036974 Apr 12 03:48:39 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 276/829] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:41 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-a35a2ff7-89c4-42c2-8737-a5285c16ccbd req-f14135a3-a300-4ac5-a2ef-763b71914dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "name": "network-vif-plugged", "status": "completed", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a35a2ff7-89c4-42c2-8737-a5285c16ccbd req-f14135a3-a300-4ac5-a2ef-763b71914dde service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a35a2ff7-89c4-42c2-8737-a5285c16ccbd req-f14135a3-a300-4ac5-a2ef-763b71914dde service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a35a2ff7-89c4-42c2-8737-a5285c16ccbd req-f14135a3-a300-4ac5-a2ef-763b71914dde service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:41 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-a35a2ff7-89c4-42c2-8737-a5285c16ccbd req-f14135a3-a300-4ac5-a2ef-763b71914dde service nova] Creating event network-vif-plugged:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:48:41 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-a35a2ff7-89c4-42c2-8737-a5285c16ccbd req-f14135a3-a300-4ac5-a2ef-763b71914dde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087439 Apr 12 03:48:41 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 277/830] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:48:47 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 HTTP/1.1 Apr 12 03:48:47 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:48:47 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:48:47 user devstack@n-api.service[62073]: Connection: close Apr 12 03:48:47 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:48:47 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:48:47 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:48:47 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:48:47 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:48:47 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:48:47 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:48:47 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:48:47 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:48:47 user devstack@n-api.service[62073]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:48:47 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:48:47 user devstack@n-api.service[62073]: method: > Apr 12 03:48:47 user devstack@n-api.service[62073]: exception: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:48:47 user devstack@n-api.service[62073]: action_args: {'id': 'a264f3f7-b0ea-482a-a438-909f06a80726'} Apr 12 03:48:47 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:48:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:48:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-5391e632-326d-4390-8527-582d0cb6fb57 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 404 len: 111 microversion: 2.1 time: 0.030621 Apr 12 03:48:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 278/831] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:47 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:48:47 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:47 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e6fb2ce2-8780-4f07-90ef-9f0e62261403 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '.version_select at 0x7f76a6e984c0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e6fb2ce2-8780-4f07-90ef-9f0e62261403 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863037271" status: 202 len: 0 microversion: 2.1 time: 0.033683 Apr 12 03:48:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 277/832] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:48:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863037271 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:48:48 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3f9c969b-b5a4-4937-bb03-91112b32c7ec tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: .version_select at 0x7f76a6828160>, body: {"keypair": {"name": "tempest-keypair-422441298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMWaRzq0i18wkyi3ji2eDJZY0v9caN/UqoTYCms3zb7sFYi3nVI2quTKtNRnFhKWj2bjy1/Mkv/ZsXUW1QOTCPWsEbRbmvA2ipXmyTgXPzbmkqrBL4q39n/p2cfT7w3RA=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:48 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-3f9c969b-b5a4-4937-bb03-91112b32c7ec tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:48:48 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-3f9c969b-b5a4-4937-bb03-91112b32c7ec tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:48:48 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3f9c969b-b5a4-4937-bb03-91112b32c7ec tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056426 Apr 12 03:48:48 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 278/833] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:48:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-127420323", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ddbce990-4cfa-40bd-b1e1-fc1531789074"}], "security_groups": [{"name": "tempest-securitygroup--484306851"}], "key_name": "tempest-keypair-422441298", "user_data": "}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:50 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] validate_networks() for [('ddbce990-4cfa-40bd-b1e1-fc1531789074', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Getting quotas for user d52637cca2114e5e99e688ee371c835a and project d13546149a4e44e1b782b99e9eb452e8. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:48:51 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:48:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-dc4ba1cb-4267-4551-9632-9412d9a4255f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.017791 Apr 12 03:48:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 279/834] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:48:50 2023] POST /compute/v2.1/servers => generated 399 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:48:51 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-030aac1f-e51c-4c6a-8fb2-7e3790c86d80 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:51 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-030aac1f-e51c-4c6a-8fb2-7e3790c86d80 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:51 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-030aac1f-e51c-4c6a-8fb2-7e3790c86d80 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-030aac1f-e51c-4c6a-8fb2-7e3790c86d80 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 200 len: 1234 microversion: 2.1 time: 0.080466 Apr 12 03:48:51 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 278/835] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:51 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:48:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=12 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-68054a51-b5c9-4126-a8a7-3f4d69651f95 req-4b13aab8-7682-491e-901e-fbe73d78ea75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:48:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-68054a51-b5c9-4126-a8a7-3f4d69651f95 req-4b13aab8-7682-491e-901e-fbe73d78ea75 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-68054a51-b5c9-4126-a8a7-3f4d69651f95 req-4b13aab8-7682-491e-901e-fbe73d78ea75 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-68054a51-b5c9-4126-a8a7-3f4d69651f95 req-4b13aab8-7682-491e-901e-fbe73d78ea75 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-68054a51-b5c9-4126-a8a7-3f4d69651f95 req-4b13aab8-7682-491e-901e-fbe73d78ea75 service nova] Creating event network-changed:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:48:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-68054a51-b5c9-4126-a8a7-3f4d69651f95 req-4b13aab8-7682-491e-901e-fbe73d78ea75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047015 Apr 12 03:48:53 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 279/836] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 3d4407f4-e078-4777-a110-cb3f922be2e8] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] HTTP exception thrown: Instance 3d4407f4-e078-4777-a110-cb3f922be2e8 could not be found. Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Request method failure captured: Apr 12 03:48:55 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 HTTP/1.1 Apr 12 03:48:55 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:48:55 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:48:55 user devstack@n-api.service[62073]: Connection: close Apr 12 03:48:55 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:48:55 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:48:55 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:48:55 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:48:55 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiW-_la1gw9Bw6zk3QykH9snh1esnPKBes2Z08Pk7xZchcypR_3FlBR3q48seWPDZF4gOuYE0LKHeqMUW2pOX5KTGwFJ_uuJd3h2fs5ye9rN2EmlHf8UzSNtO-jlK0EXW5r46nYNbaR7nNDyEvT6xGZ-vwykNOIQq2kcIVYbUfxPMUs Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Project-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e1fa352a8c144a1aada7ce0d8818429"}]}] Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Tenant-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:48:55 user devstack@n-api.service[62073]: X-User: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:48:55 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:48:55 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:48:55 user devstack@n-api.service[62073]: X-User-Id: d99be569057f432484e4a60b46882bbd Apr 12 03:48:55 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:48:55 user devstack@n-api.service[62073]: method: > Apr 12 03:48:55 user devstack@n-api.service[62073]: exception: Instance 3d4407f4-e078-4777-a110-cb3f922be2e8 could not be found. Apr 12 03:48:55 user devstack@n-api.service[62073]: action_args: {'id': '3d4407f4-e078-4777-a110-cb3f922be2e8'} Apr 12 03:48:55 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4407f4-e078-4777-a110-cb3f922be2e8 could not be found. Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4407f4-e078-4777-a110-cb3f922be2e8 could not be found. Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4407f4-e078-4777-a110-cb3f922be2e8 could not be found. Apr 12 03:48:55 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Returning 404 to user: Instance 3d4407f4-e078-4777-a110-cb3f922be2e8 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:48:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-24dfe9d7-3e34-4ac4-a6cb-ffcfcff2580f tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8" status: 404 len: 111 microversion: 2.87 time: 0.035562 Apr 12 03:48:55 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 280/837] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:48:55 2023] GET /compute/v2.1/servers/3d4407f4-e078-4777-a110-cb3f922be2e8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:48:55 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-8618e686-8881-42a1-8c6c-b96889614ead tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 204 len: 0 microversion: 2.87 time: 0.111747 Apr 12 03:48:55 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 279/838] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:48:55 2023] DELETE /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:55 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-73ac9856-2092-4af2-81b0-da9a99268b22 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 200 len: 1774 microversion: 2.87 time: 0.190003 Apr 12 03:48:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 280/839] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:48:55 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 1774 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-fb64a3a4-0ef1-4cad-8fed-4d2cb86f664a req-56fcc0b1-cd85-4b83-84a9-d9159c639576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "name": "network-vif-plugged", "status": "completed", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fb64a3a4-0ef1-4cad-8fed-4d2cb86f664a req-56fcc0b1-cd85-4b83-84a9-d9159c639576 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fb64a3a4-0ef1-4cad-8fed-4d2cb86f664a req-56fcc0b1-cd85-4b83-84a9-d9159c639576 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:55 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-fb64a3a4-0ef1-4cad-8fed-4d2cb86f664a req-56fcc0b1-cd85-4b83-84a9-d9159c639576 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] Creating event network-vif-unplugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-5912368b-1182-43f5-8d01-4a04e0735b66 req-3e7dd77e-551c-4537-989f-853da37366b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029672 Apr 12 03:48:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 281/840] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-fb64a3a4-0ef1-4cad-8fed-4d2cb86f664a req-56fcc0b1-cd85-4b83-84a9-d9159c639576 service nova] Creating event network-vif-plugged:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:48:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-fb64a3a4-0ef1-4cad-8fed-4d2cb86f664a req-56fcc0b1-cd85-4b83-84a9-d9159c639576 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045906 Apr 12 03:48:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 280/841] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:58 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-plugged", "status": "completed", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}, {"server_uuid": "bcd267d2-5b2c-4ed2-b634-0210fae94dfd", "name": "network-vif-deleted", "tag": "a4385731-05f2-4eac-a5bb-9a987a3f5472"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Creating event network-vif-unplugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Creating event network-vif-plugged:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] Creating event network-vif-deleted:a4385731-05f2-4eac-a5bb-9a987a3f5472 for instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd on user Apr 12 03:48:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-3323e22e-991e-46e4-ae3e-62498cc2773f req-9b1ae5d4-581e-4dfc-9f94-9cf66fafb757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "name": "network-vif-plugged", "status": "completed", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:48:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-2a5f211b-3c42-47a7-a7c7-b20d14f64977 req-69eb3e2d-23f5-45af-a3f2-fe74edcef187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033841 Apr 12 03:48:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 281/842] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3323e22e-991e-46e4-ae3e-62498cc2773f req-9b1ae5d4-581e-4dfc-9f94-9cf66fafb757 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3323e22e-991e-46e4-ae3e-62498cc2773f req-9b1ae5d4-581e-4dfc-9f94-9cf66fafb757 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-3323e22e-991e-46e4-ae3e-62498cc2773f req-9b1ae5d4-581e-4dfc-9f94-9cf66fafb757 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-3323e22e-991e-46e4-ae3e-62498cc2773f req-9b1ae5d4-581e-4dfc-9f94-9cf66fafb757 service nova] Creating event network-vif-plugged:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:48:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-3323e22e-991e-46e4-ae3e-62498cc2773f req-9b1ae5d4-581e-4dfc-9f94-9cf66fafb757 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033479 Apr 12 03:48:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 282/843] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:48:59 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:48:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-0e0a7272-306c-472a-a306-1f3976c7de36 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873" status: 200 len: 1438 microversion: 2.1 time: 0.157733 Apr 12 03:48:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 281/844] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:48:59 2023] GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 => generated 1438 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=7 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=10 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:23 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-7d86d2c7-159e-40ac-ba9a-425469c2d4cf tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076" status: 200 len: 1537 microversion: 2.1 time: 0.175150 Apr 12 03:49:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 282/845] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:49:23 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=18 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:28 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-871cae37-545d-45c0-bdb1-bfaebc626c55 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.193925 Apr 12 03:49:28 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 283/846] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:49:28 2023] GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13/os-interface => generated 283 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-3a8502e0-2213-42f2-b0ae-fc36b5196798 req-a9281297-d14d-41ce-9acd-8a5f74ae6469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3a8502e0-2213-42f2-b0ae-fc36b5196798 req-a9281297-d14d-41ce-9acd-8a5f74ae6469 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3a8502e0-2213-42f2-b0ae-fc36b5196798 req-a9281297-d14d-41ce-9acd-8a5f74ae6469 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3a8502e0-2213-42f2-b0ae-fc36b5196798 req-a9281297-d14d-41ce-9acd-8a5f74ae6469 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:29 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-3a8502e0-2213-42f2-b0ae-fc36b5196798 req-a9281297-d14d-41ce-9acd-8a5f74ae6469 service nova] Creating event network-changed:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:49:29 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-3a8502e0-2213-42f2-b0ae-fc36b5196798 req-a9281297-d14d-41ce-9acd-8a5f74ae6469 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039445 Apr 12 03:49:29 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 282/847] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:31 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-441149863", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "9cac7f86-c0da-4b81-bdde-50662f79d265"}], "security_groups": [{"name": "tempest-securitygroup--1184528712"}], "key_name": "tempest-keypair-364276420", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f699cce1-7b7a-47fc-9c5e-161e74d0becd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] validate_networks() for [('9cac7f86-c0da-4b81-bdde-50662f79d265', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:49:32 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f699cce1-7b7a-47fc-9c5e-161e74d0becd',volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:49:32 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4cdaa358-5a81-4c35-9c90-c7d3af72c4ca tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.757099 Apr 12 03:49:32 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 283/848] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:49:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:49:32 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-82a7b31f-e779-4675-91bd-03ebab155525 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:32 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-82a7b31f-e779-4675-91bd-03ebab155525 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:32 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-82a7b31f-e779-4675-91bd-03ebab155525 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-82a7b31f-e779-4675-91bd-03ebab155525 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1074 microversion: 2.1 time: 0.066604 Apr 12 03:49:32 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 284/849] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:49:32 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1074 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:49:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-539ed144-8436-4419-856a-3d8d5b33c442 req-fe6fe487-a3e9-4b9d-ae28-c233320f53e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-539ed144-8436-4419-856a-3d8d5b33c442 req-fe6fe487-a3e9-4b9d-ae28-c233320f53e7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-539ed144-8436-4419-856a-3d8d5b33c442 req-fe6fe487-a3e9-4b9d-ae28-c233320f53e7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-539ed144-8436-4419-856a-3d8d5b33c442 req-fe6fe487-a3e9-4b9d-ae28-c233320f53e7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-539ed144-8436-4419-856a-3d8d5b33c442 req-fe6fe487-a3e9-4b9d-ae28-c233320f53e7 service nova] Creating event network-changed:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:49:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-539ed144-8436-4419-856a-3d8d5b33c442 req-fe6fe487-a3e9-4b9d-ae28-c233320f53e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053746 Apr 12 03:49:35 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 283/850] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:38 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-76538f79-698c-4adf-95c3-9843c2702f12 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-76538f79-698c-4adf-95c3-9843c2702f12 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-76538f79-698c-4adf-95c3-9843c2702f12 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-76538f79-698c-4adf-95c3-9843c2702f12 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:38 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-76538f79-698c-4adf-95c3-9843c2702f12 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Going to try to start instance {{(pid=62074) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 03:49:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-76538f79-698c-4adf-95c3-9843c2702f12 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action" status: 202 len: 0 microversion: 2.1 time: 0.090671 Apr 12 03:49:38 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 284/851] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:49:38 2023] POST /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:38 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-aca1755e-7888-490c-97f6-5b056ea4ee1b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1653 microversion: 2.1 time: 0.255755 Apr 12 03:49:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 285/852] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:49:38 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1653 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:41 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-719a5f55-0f85-42d9-a322-c660ba88179f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 200 len: 1544 microversion: 2.1 time: 0.346245 Apr 12 03:49:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 284/853] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:49:41 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 1544 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:49:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c221637c-f2d7-40df-992d-b9785b2813eb req-8bdc2256-b943-49d1-bc54-8d5fb9c07cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c221637c-f2d7-40df-992d-b9785b2813eb req-8bdc2256-b943-49d1-bc54-8d5fb9c07cbb service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c221637c-f2d7-40df-992d-b9785b2813eb req-8bdc2256-b943-49d1-bc54-8d5fb9c07cbb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c221637c-f2d7-40df-992d-b9785b2813eb req-8bdc2256-b943-49d1-bc54-8d5fb9c07cbb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c221637c-f2d7-40df-992d-b9785b2813eb req-8bdc2256-b943-49d1-bc54-8d5fb9c07cbb service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:49:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c221637c-f2d7-40df-992d-b9785b2813eb req-8bdc2256-b943-49d1-bc54-8d5fb9c07cbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038534 Apr 12 03:49:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 285/854] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-plugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}, {"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-plugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:49:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Creating event network-vif-plugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:49:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] Creating event network-vif-plugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:49:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7755b02a-c3ea-4c8c-8a03-29a2bc270bbe req-60c78195-a3d5-4bea-a46b-edef597883a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035919 Apr 12 03:49:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 286/855] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:44 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: bcd267d2-5b2c-4ed2-b634-0210fae94dfd] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] HTTP exception thrown: Instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd could not be found. Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Request method failure captured: Apr 12 03:49:45 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd HTTP/1.1 Apr 12 03:49:45 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:49:45 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:49:45 user devstack@n-api.service[62072]: Connection: close Apr 12 03:49:45 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:49:45 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:49:45 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:49:45 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:49:45 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW-_la1gw9Bw6zk3QykH9snh1esnPKBes2Z08Pk7xZchcypR_3FlBR3q48seWPDZF4gOuYE0LKHeqMUW2pOX5KTGwFJ_uuJd3h2fs5ye9rN2EmlHf8UzSNtO-jlK0EXW5r46nYNbaR7nNDyEvT6xGZ-vwykNOIQq2kcIVYbUfxPMUs Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Project-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e1fa352a8c144a1aada7ce0d8818429"}]}] Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Tenant-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:49:45 user devstack@n-api.service[62072]: X-User: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:49:45 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:49:45 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:49:45 user devstack@n-api.service[62072]: X-User-Id: d99be569057f432484e4a60b46882bbd Apr 12 03:49:45 user devstack@n-api.service[62072]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:49:45 user devstack@n-api.service[62072]: method: > Apr 12 03:49:45 user devstack@n-api.service[62072]: exception: Instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd could not be found. Apr 12 03:49:45 user devstack@n-api.service[62072]: action_args: {'id': 'bcd267d2-5b2c-4ed2-b634-0210fae94dfd'} Apr 12 03:49:45 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd could not be found. Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd could not be found. Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd could not be found. Apr 12 03:49:45 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:49:45 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Returning 404 to user: Instance bcd267d2-5b2c-4ed2-b634-0210fae94dfd could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:49:45 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-49f11daa-9040-440a-b9cd-0748fed03b55 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd" status: 404 len: 111 microversion: 2.87 time: 0.040670 Apr 12 03:49:45 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 285/856] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:49:45 2023] GET /compute/v2.1/servers/bcd267d2-5b2c-4ed2-b634-0210fae94dfd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:45 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:49:45 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8ff2cbb4-c03e-4073-9b89-0e557dc57842 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5" status: 204 len: 0 microversion: 2.87 time: 0.128911 Apr 12 03:49:45 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 286/857] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 03:49:45 2023] DELETE /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:45 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:46 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:46 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:46 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd99be569057f432484e4a60b46882bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1fa352a8c144a1aada7ce0d8818429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:49:46 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c5056f97-afdc-4e8f-a922-ed0550478913 tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5" status: 200 len: 1698 microversion: 2.87 time: 0.195749 Apr 12 03:49:46 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 287/858] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:49:45 2023] GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 03:49:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-601feb77-9a23-4a7f-847b-0f38fa5fd86c req-168d6530-6f0a-44f1-a67a-3798a8d05cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0904c3-74e0-47bb-a832-758a7035b2f5", "name": "network-vif-unplugged", "status": "completed", "tag": "dce84390-a2f8-4047-b513-eec5845a2399"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-601feb77-9a23-4a7f-847b-0f38fa5fd86c req-168d6530-6f0a-44f1-a67a-3798a8d05cbf service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-601feb77-9a23-4a7f-847b-0f38fa5fd86c req-168d6530-6f0a-44f1-a67a-3798a8d05cbf service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-601feb77-9a23-4a7f-847b-0f38fa5fd86c req-168d6530-6f0a-44f1-a67a-3798a8d05cbf service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-601feb77-9a23-4a7f-847b-0f38fa5fd86c req-168d6530-6f0a-44f1-a67a-3798a8d05cbf service nova] Creating event network-vif-unplugged:dce84390-a2f8-4047-b513-eec5845a2399 for instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 on user Apr 12 03:49:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-601feb77-9a23-4a7f-847b-0f38fa5fd86c req-168d6530-6f0a-44f1-a67a-3798a8d05cbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032162 Apr 12 03:49:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 286/859] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:47 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-3655b505-fb81-4cac-9e19-1afe4a2e2e82 req-7f16808f-25d7-4ac1-b8c8-af4978ea4075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0904c3-74e0-47bb-a832-758a7035b2f5", "name": "network-vif-deleted", "tag": "dce84390-a2f8-4047-b513-eec5845a2399"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3655b505-fb81-4cac-9e19-1afe4a2e2e82 req-7f16808f-25d7-4ac1-b8c8-af4978ea4075 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3655b505-fb81-4cac-9e19-1afe4a2e2e82 req-7f16808f-25d7-4ac1-b8c8-af4978ea4075 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:47 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-3655b505-fb81-4cac-9e19-1afe4a2e2e82 req-7f16808f-25d7-4ac1-b8c8-af4978ea4075 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-3655b505-fb81-4cac-9e19-1afe4a2e2e82 req-7f16808f-25d7-4ac1-b8c8-af4978ea4075 service nova] Creating event network-vif-deleted:dce84390-a2f8-4047-b513-eec5845a2399 for instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 on user Apr 12 03:49:47 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-3655b505-fb81-4cac-9e19-1afe4a2e2e82 req-7f16808f-25d7-4ac1-b8c8-af4978ea4075 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035661 Apr 12 03:49:47 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 287/860] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:49:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d9d1b322-6f73-4ee4-8196-b20d02370780 req-ae1882e3-7995-4f07-a78e-501b48c0eb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0904c3-74e0-47bb-a832-758a7035b2f5", "name": "network-vif-plugged", "status": "completed", "tag": "dce84390-a2f8-4047-b513-eec5845a2399"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:49:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d9d1b322-6f73-4ee4-8196-b20d02370780 req-ae1882e3-7995-4f07-a78e-501b48c0eb9e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:49:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d9d1b322-6f73-4ee4-8196-b20d02370780 req-ae1882e3-7995-4f07-a78e-501b48c0eb9e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:49:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d9d1b322-6f73-4ee4-8196-b20d02370780 req-ae1882e3-7995-4f07-a78e-501b48c0eb9e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:49:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d9d1b322-6f73-4ee4-8196-b20d02370780 req-ae1882e3-7995-4f07-a78e-501b48c0eb9e service nova] Creating event network-vif-plugged:dce84390-a2f8-4047-b513-eec5845a2399 for instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 on user Apr 12 03:49:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d9d1b322-6f73-4ee4-8196-b20d02370780 req-ae1882e3-7995-4f07-a78e-501b48c0eb9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030548 Apr 12 03:49:48 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 288/861] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:49:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=10 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=14 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:00 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:50:00 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b6eae792-1841-4aac-9f5b-2460aa78a095 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873" status: 200 len: 1438 microversion: 2.1 time: 0.175316 Apr 12 03:50:00 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 287/862] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:00 2023] GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 => generated 1438 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:50:02 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:02 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:02 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-4c722a25-7da9-437a-8ad5-f86fc2ca618e req-dd51a32c-dc7b-47a1-adcd-eee59684569b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4c722a25-7da9-437a-8ad5-f86fc2ca618e req-dd51a32c-dc7b-47a1-adcd-eee59684569b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4c722a25-7da9-437a-8ad5-f86fc2ca618e req-dd51a32c-dc7b-47a1-adcd-eee59684569b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:02 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4c722a25-7da9-437a-8ad5-f86fc2ca618e req-dd51a32c-dc7b-47a1-adcd-eee59684569b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-4c722a25-7da9-437a-8ad5-f86fc2ca618e req-dd51a32c-dc7b-47a1-adcd-eee59684569b service nova] Creating event network-changed:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:50:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-4c722a25-7da9-437a-8ad5-f86fc2ca618e req-dd51a32c-dc7b-47a1-adcd-eee59684569b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038982 Apr 12 03:50:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 288/863] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=16 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=20 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-35494c42-bdbe-4193-863d-0eb8a22f7342 req-3c0c7673-fe94-4750-9a94-2b44e56677e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-35494c42-bdbe-4193-863d-0eb8a22f7342 req-3c0c7673-fe94-4750-9a94-2b44e56677e2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-35494c42-bdbe-4193-863d-0eb8a22f7342 req-3c0c7673-fe94-4750-9a94-2b44e56677e2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-35494c42-bdbe-4193-863d-0eb8a22f7342 req-3c0c7673-fe94-4750-9a94-2b44e56677e2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-35494c42-bdbe-4193-863d-0eb8a22f7342 req-3c0c7673-fe94-4750-9a94-2b44e56677e2 service nova] Creating event network-changed:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:50:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-35494c42-bdbe-4193-863d-0eb8a22f7342 req-3c0c7673-fe94-4750-9a94-2b44e56677e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031204 Apr 12 03:50:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 288/864] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:02 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:50:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f059cc33-d8a6-44e7-a6d4-38d9456bfd6d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873" status: 204 len: 0 microversion: 2.1 time: 0.136051 Apr 12 03:50:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 289/865] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:50:02 2023] DELETE /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:03 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:50:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-cb8abfbf-d073-44cf-ad15-f2c0eed40124 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873" status: 200 len: 1563 microversion: 2.1 time: 0.246669 Apr 12 03:50:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 289/866] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:03 2023] GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:50:04 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-86393e8b-e06c-4ff3-9535-96f7a486e251 req-105aa97c-460e-4937-8639-7d8bbb779b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "name": "network-vif-deleted", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-86393e8b-e06c-4ff3-9535-96f7a486e251 req-105aa97c-460e-4937-8639-7d8bbb779b65 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-86393e8b-e06c-4ff3-9535-96f7a486e251 req-105aa97c-460e-4937-8639-7d8bbb779b65 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:04 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-86393e8b-e06c-4ff3-9535-96f7a486e251 req-105aa97c-460e-4937-8639-7d8bbb779b65 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:04 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-86393e8b-e06c-4ff3-9535-96f7a486e251 req-105aa97c-460e-4937-8639-7d8bbb779b65 service nova] Creating event network-vif-deleted:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:50:04 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-86393e8b-e06c-4ff3-9535-96f7a486e251 req-105aa97c-460e-4937-8639-7d8bbb779b65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 Apr 12 03:50:04 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 289/867] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "name": "network-vif-unplugged", "status": "completed", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}, {"server_uuid": "6e8d7159-e7c4-4dbd-ab06-074b1d4e3873", "name": "network-vif-plugged", "status": "completed", "tag": "c06ddd73-9521-41d8-a907-7af844b2adac"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] Creating event network-vif-unplugged:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:50:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] Creating event network-vif-plugged:c06ddd73-9521-41d8-a907-7af844b2adac for instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 on user Apr 12 03:50:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-e9a71ab0-809b-4fb5-a85b-c7a46d1942a4 req-13086b21-983d-40e2-bb3b-59e9f3e53ead service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033550 Apr 12 03:50:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 290/868] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:22 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:23 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:50:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-fc462508-7fbe-45fa-b14a-d7618ac922fd tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1427 microversion: 2.1 time: 0.161693 Apr 12 03:50:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 290/869] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:22 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=10 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:23 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:50:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f9458604-fa7d-4473-9163-f1c48f81a6c7 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076" status: 200 len: 1537 microversion: 2.1 time: 0.210588 Apr 12 03:50:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 290/870] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:23 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:50:26 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:26 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9f5c97fc-58fc-424f-b842-5f5fd6c3b4c1 req-a1a490bf-bf3b-4ee3-9ca9-89d57e7bb45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9f5c97fc-58fc-424f-b842-5f5fd6c3b4c1 req-a1a490bf-bf3b-4ee3-9ca9-89d57e7bb45f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9f5c97fc-58fc-424f-b842-5f5fd6c3b4c1 req-a1a490bf-bf3b-4ee3-9ca9-89d57e7bb45f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9f5c97fc-58fc-424f-b842-5f5fd6c3b4c1 req-a1a490bf-bf3b-4ee3-9ca9-89d57e7bb45f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9f5c97fc-58fc-424f-b842-5f5fd6c3b4c1 req-a1a490bf-bf3b-4ee3-9ca9-89d57e7bb45f service nova] Creating event network-changed:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:50:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9f5c97fc-58fc-424f-b842-5f5fd6c3b4c1 req-a1a490bf-bf3b-4ee3-9ca9-89d57e7bb45f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039284 Apr 12 03:50:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 291/871] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ce5801-6746-495f-93bd-4147bd863b6e"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9d4a616c-bece-4bcf-8ceb-8ee6360e0421 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333302 Apr 12 03:50:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 291/872] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:50:26 2023] POST /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:28 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:50:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-536d9407-373f-4663-a30b-c07e84c4dfe5 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1657 microversion: 2.1 time: 0.151318 Apr 12 03:50:28 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 291/873] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:28 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:34 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lazy-loading 'services' on Instance uuid a6d7d43b-ac65-4ebf-9645-b17e61397076 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:50:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-53cc13a2-048d-46a6-bc2f-a33e1e61e14d tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments/11ce5801-6746-495f-93bd-4147bd863b6e" status: 202 len: 0 microversion: 2.1 time: 0.255435 Apr 12 03:50:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 292/874] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:50:34 2023] DELETE /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments/11ce5801-6746-495f-93bd-4147bd863b6e => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a115b9df-c26c-4dd7-b23e-5e396ab993b1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068828 Apr 12 03:50:35 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 292/875] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:50:35 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] [instance: 2d0904c3-74e0-47bb-a832-758a7035b2f5] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] HTTP exception thrown: Instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 could not be found. Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Request method failure captured: Apr 12 03:50:36 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 HTTP/1.1 Apr 12 03:50:36 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:50:36 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:50:36 user devstack@n-api.service[62072]: Connection: close Apr 12 03:50:36 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:50:36 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:50:36 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:50:36 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:50:36 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiW-_la1gw9Bw6zk3QykH9snh1esnPKBes2Z08Pk7xZchcypR_3FlBR3q48seWPDZF4gOuYE0LKHeqMUW2pOX5KTGwFJ_uuJd3h2fs5ye9rN2EmlHf8UzSNtO-jlK0EXW5r46nYNbaR7nNDyEvT6xGZ-vwykNOIQq2kcIVYbUfxPMUs Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Project-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e1fa352a8c144a1aada7ce0d8818429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e1fa352a8c144a1aada7ce0d8818429"}]}] Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Tenant-Id: 6e1fa352a8c144a1aada7ce0d8818429 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458 Apr 12 03:50:36 user devstack@n-api.service[62072]: X-User: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:50:36 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:50:36 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:50:36 user devstack@n-api.service[62072]: X-User-Id: d99be569057f432484e4a60b46882bbd Apr 12 03:50:36 user devstack@n-api.service[62072]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member Apr 12 03:50:36 user devstack@n-api.service[62072]: method: > Apr 12 03:50:36 user devstack@n-api.service[62072]: exception: Instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 could not be found. Apr 12 03:50:36 user devstack@n-api.service[62072]: action_args: {'id': '2d0904c3-74e0-47bb-a832-758a7035b2f5'} Apr 12 03:50:36 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 could not be found. Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 could not be found. Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 could not be found. Apr 12 03:50:36 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] Returning 404 to user: Instance 2d0904c3-74e0-47bb-a832-758a7035b2f5 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:50:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-33a2234e-bda4-4e1d-8398-dea79bd4875d tempest-ServerBootFromVolumeStableRescueTest-590302458 tempest-ServerBootFromVolumeStableRescueTest-590302458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5" status: 404 len: 111 microversion: 2.87 time: 0.029562 Apr 12 03:50:36 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 292/876] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 03:50:36 2023] GET /compute/v2.1/servers/2d0904c3-74e0-47bb-a832-758a7035b2f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 03:50:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-33e8f4ec-e899-45ca-af55-ffba4c928420 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Action: 'create', calling method: .version_select at 0x7f76a6ac81f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-154879846", "metadata": {"Type": "work"}}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-33e8f4ec-e899-45ca-af55-ffba4c928420 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.470193 Apr 12 03:50:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 293/877] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 03:50:40 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 472 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 03:50:40 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-21207506-263f-44e2-b111-5ed5c9acbbcc tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a682a710>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:41 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-21207506-263f-44e2-b111-5ed5c9acbbcc tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 200 len: 352 microversion: 2.1 time: 0.179972 Apr 12 03:50:41 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 293/878] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:50:40 2023] GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 352 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1a5a6943-f625-48f2-a0b8-9c1eb0d84947 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.105743 Apr 12 03:50:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 293/879] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:50:41 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-interface => generated 283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c79ddaa7-e181-4719-a4e1-0c8bb3ad3c2a tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a6aca9e0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c79ddaa7-e181-4719-a4e1-0c8bb3ad3c2a tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 200 len: 353 microversion: 2.1 time: 0.061734 Apr 12 03:50:42 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 294/880] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:50:42 2023] GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-7892ae75-f5d5-4d2c-85d4-c82e187260a6 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a68b6a70>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-7892ae75-f5d5-4d2c-85d4-c82e187260a6 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 200 len: 353 microversion: 2.1 time: 0.069993 Apr 12 03:50:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 294/881] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:50:42 2023] GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-641bb8f2-5a5b-41f3-a9c7-c4b672d5e6b8 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a6bef1c0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-641bb8f2-5a5b-41f3-a9c7-c4b672d5e6b8 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 202 len: 0 microversion: 2.1 time: 0.072829 Apr 12 03:50:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 294/882] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:50:42 2023] DELETE /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 03:50:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c1beec47-b8b4-4021-b1dc-20349f91ead5 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a6aca290>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c1beec47-b8b4-4021-b1dc-20349f91ead5 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 200 len: 352 microversion: 2.1 time: 0.058838 Apr 12 03:50:42 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 295/883] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:50:42 2023] GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:42 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-59bc1da7-1be3-4cf0-8425-05428ff115d2 req-9f20f03a-8adf-4d4d-9b4c-cc04988aae69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-59bc1da7-1be3-4cf0-8425-05428ff115d2 req-9f20f03a-8adf-4d4d-9b4c-cc04988aae69 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-59bc1da7-1be3-4cf0-8425-05428ff115d2 req-9f20f03a-8adf-4d4d-9b4c-cc04988aae69 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:42 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-59bc1da7-1be3-4cf0-8425-05428ff115d2 req-9f20f03a-8adf-4d4d-9b4c-cc04988aae69 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-59bc1da7-1be3-4cf0-8425-05428ff115d2 req-9f20f03a-8adf-4d4d-9b4c-cc04988aae69 service nova] Creating event network-changed:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:50:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-59bc1da7-1be3-4cf0-8425-05428ff115d2 req-9f20f03a-8adf-4d4d-9b4c-cc04988aae69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109869 Apr 12 03:50:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 295/884] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-fe94d005-c601-45c5-9e00-19df594074a5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/ips" status: 200 len: 109 microversion: 2.1 time: 0.039772 Apr 12 03:50:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 295/885] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:50:42 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:43 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-423ca2b9-4605-40e9-9679-ab13d1f9fb64 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a696cca0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:43 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-423ca2b9-4605-40e9-9679-ab13d1f9fb64 tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 200 len: 352 microversion: 2.1 time: 0.052329 Apr 12 03:50:43 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 296/886] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:50:43 2023] GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35d8d71b-b4ab-44f9-887a-fc760be16530"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e794c147-7acf-4149-838b-c51a9f1e79cd tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Calling method '.version_select at 0x7f76a6e9ba30>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:44 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-e794c147-7acf-4149-838b-c51a9f1e79cd tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] HTTP exception thrown: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. Apr 12 03:50:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e794c147-7acf-4149-838b-c51a9f1e79cd tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Request method failure captured: Apr 12 03:50:44 user devstack@n-api.service[62072]: request: GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b HTTP/1.1 Apr 12 03:50:44 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:50:44 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:50:44 user devstack@n-api.service[62072]: Connection: close Apr 12 03:50:44 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:50:44 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:50:44 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:50:44 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:50:44 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiqQTinBhwz5LgNjhyPxp79FkoX4h7Y-5PCGV4Z22r1jLbBicIxRWCzbX12k9OKZgCh2SzNlwmxJb3Pp9FpQat4AM1ti8Sigeebeiojx6t0hyjkSIJgfTvJgF0TMZjBFPu6cmD9bxr973J4-YjbuWcTW56Tcs2y1e5M8QnWA_fozrW8 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Project-Id: 8fc0387329a8459d8b7d17db42c2d291 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Project-Name: tempest-VolumesGetTestJSON-1978822899 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fc0387329a8459d8b7d17db42c2d291"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fc0387329a8459d8b7d17db42c2d291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fc0387329a8459d8b7d17db42c2d291"}]}] Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Tenant: tempest-VolumesGetTestJSON-1978822899 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Tenant-Id: 8fc0387329a8459d8b7d17db42c2d291 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-VolumesGetTestJSON-1978822899 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-User: tempest-VolumesGetTestJSON-1978822899-project-member Apr 12 03:50:44 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:50:44 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:50:44 user devstack@n-api.service[62072]: X-User-Id: c160cb0efba94565be6f4cc8089b2379 Apr 12 03:50:44 user devstack@n-api.service[62072]: X-User-Name: tempest-VolumesGetTestJSON-1978822899-project-member Apr 12 03:50:44 user devstack@n-api.service[62072]: method: Apr 12 03:50:44 user devstack@n-api.service[62072]: exception: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. Apr 12 03:50:44 user devstack@n-api.service[62072]: action_args: {'id': 'cb2e6513-d030-4fed-b099-97a74116c00b'} Apr 12 03:50:44 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. (HTTP 404) (Request-ID: req-86fd636c-00b1-4f9e-931c-d40a83893270) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. Apr 12 03:50:44 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:50:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e794c147-7acf-4149-838b-c51a9f1e79cd tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] Returning 404 to user: Volume cb2e6513-d030-4fed-b099-97a74116c00b could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:50:44 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e794c147-7acf-4149-838b-c51a9f1e79cd tempest-VolumesGetTestJSON-1978822899 tempest-VolumesGetTestJSON-1978822899-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b" status: 404 len: 109 microversion: 2.1 time: 0.042688 Apr 12 03:50:44 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 296/887] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:50:44 2023] GET /compute/v2.1/os-volumes/cb2e6513-d030-4fed-b099-97a74116c00b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:50:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ff6130a1-fa0e-49d1-8a9f-d6a01d2895b7 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305011 Apr 12 03:50:44 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 296/888] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:50:44 2023] POST /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:51 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lazy-loading 'services' on Instance uuid 93a2f40a-1eae-4986-b418-ddbf45723196 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:50:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f13a81ca-0b61-4144-b171-c25bafdf7436 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments/35d8d71b-b4ab-44f9-887a-fc760be16530" status: 202 len: 0 microversion: 2.1 time: 0.165691 Apr 12 03:50:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 297/889] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:50:51 2023] DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments/35d8d71b-b4ab-44f9-887a-fc760be16530 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:51 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:51 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1a9ca003-1aea-4084-9859-08d20a7178d5 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Apr 12 03:50:51 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 297/890] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:50:51 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=11 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 could not be found. Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:50:53 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 HTTP/1.1 Apr 12 03:50:53 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:50:53 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:50:53 user devstack@n-api.service[62074]: Connection: close Apr 12 03:50:53 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:50:53 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:50:53 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:50:53 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:50:53 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:50:53 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:50:53 user devstack@n-api.service[62074]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:50:53 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:50:53 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:50:53 user devstack@n-api.service[62074]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:50:53 user devstack@n-api.service[62074]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:50:53 user devstack@n-api.service[62074]: method: > Apr 12 03:50:53 user devstack@n-api.service[62074]: exception: Instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 could not be found. Apr 12 03:50:53 user devstack@n-api.service[62074]: action_args: {'id': '6e8d7159-e7c4-4dbd-ab06-074b1d4e3873'} Apr 12 03:50:53 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 could not be found. Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 could not be found. Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 could not be found. Apr 12 03:50:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:50:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:50:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9af0ecf9-7b9c-46a5-b65f-f7e20297586c tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873" status: 404 len: 111 microversion: 2.1 time: 0.033674 Apr 12 03:50:53 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 297/891] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:53 2023] GET /compute/v2.1/servers/6e8d7159-e7c4-4dbd-ab06-074b1d4e3873 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:58 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-d63a044f-1621-4973-bb22-5382b148da07 req-a0481485-9400-4d5d-9fd2-dfa5aa3eab3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=13 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d63a044f-1621-4973-bb22-5382b148da07 req-a0481485-9400-4d5d-9fd2-dfa5aa3eab3c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d63a044f-1621-4973-bb22-5382b148da07 req-a0481485-9400-4d5d-9fd2-dfa5aa3eab3c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-d63a044f-1621-4973-bb22-5382b148da07 req-a0481485-9400-4d5d-9fd2-dfa5aa3eab3c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=29 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:50:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-d63a044f-1621-4973-bb22-5382b148da07 req-a0481485-9400-4d5d-9fd2-dfa5aa3eab3c service nova] Creating event network-changed:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:50:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-d63a044f-1621-4973-bb22-5382b148da07 req-a0481485-9400-4d5d-9fd2-dfa5aa3eab3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135344 Apr 12 03:50:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 298/892] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:50:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6723ab86-3cc3-4d6a-bb60-9daa73bb4d48 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef" status: 204 len: 0 microversion: 2.1 time: 0.149579 Apr 12 03:50:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 298/893] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:50:58 2023] DELETE /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:58 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b348933224558aad1cb12921f100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003688353e2f4b36831c574ebaf65173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:50:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a1b90f00-2ebb-43b5-abaf-87468e5ea11d tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef" status: 200 len: 1565 microversion: 2.1 time: 0.184161 Apr 12 03:50:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 298/894] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:50:58 2023] GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-9bcbf881-7d03-4022-bb80-37530fcb31f9 req-89977fd2-e36b-4d6d-822c-c1c293b90223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "name": "network-vif-unplugged", "status": "completed", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9bcbf881-7d03-4022-bb80-37530fcb31f9 req-89977fd2-e36b-4d6d-822c-c1c293b90223 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9bcbf881-7d03-4022-bb80-37530fcb31f9 req-89977fd2-e36b-4d6d-822c-c1c293b90223 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:50:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9bcbf881-7d03-4022-bb80-37530fcb31f9 req-89977fd2-e36b-4d6d-822c-c1c293b90223 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:50:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-9bcbf881-7d03-4022-bb80-37530fcb31f9 req-89977fd2-e36b-4d6d-822c-c1c293b90223 service nova] Creating event network-vif-unplugged:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:50:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-9bcbf881-7d03-4022-bb80-37530fcb31f9 req-89977fd2-e36b-4d6d-822c-c1c293b90223 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030147 Apr 12 03:50:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 299/895] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:00 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-0b122334-960f-48f8-abaf-c31b731a8b68 req-a960d896-6229-4bbf-879d-3877461a7965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "name": "network-vif-deleted", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0b122334-960f-48f8-abaf-c31b731a8b68 req-a960d896-6229-4bbf-879d-3877461a7965 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0b122334-960f-48f8-abaf-c31b731a8b68 req-a960d896-6229-4bbf-879d-3877461a7965 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:00 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-0b122334-960f-48f8-abaf-c31b731a8b68 req-a960d896-6229-4bbf-879d-3877461a7965 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-0b122334-960f-48f8-abaf-c31b731a8b68 req-a960d896-6229-4bbf-879d-3877461a7965 service nova] Creating event network-vif-deleted:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:51:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-0b122334-960f-48f8-abaf-c31b731a8b68 req-a960d896-6229-4bbf-879d-3877461a7965 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Apr 12 03:51:00 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 299/896] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-6bccd904-aa9f-4ddf-a0c6-7dd1b2968f7f req-55640ef2-1633-43e4-961b-8b2115990966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12351dbd-0f2e-40a6-a10a-f40f5b6250ef", "name": "network-vif-plugged", "status": "completed", "tag": "e1586e63-ee44-4717-ad47-886b1c3f01d0"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-6bccd904-aa9f-4ddf-a0c6-7dd1b2968f7f req-55640ef2-1633-43e4-961b-8b2115990966 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-6bccd904-aa9f-4ddf-a0c6-7dd1b2968f7f req-55640ef2-1633-43e4-961b-8b2115990966 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-6bccd904-aa9f-4ddf-a0c6-7dd1b2968f7f req-55640ef2-1633-43e4-961b-8b2115990966 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-6bccd904-aa9f-4ddf-a0c6-7dd1b2968f7f req-55640ef2-1633-43e4-961b-8b2115990966 service nova] Creating event network-vif-plugged:e1586e63-ee44-4717-ad47-886b1c3f01d0 for instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef on user Apr 12 03:51:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-6bccd904-aa9f-4ddf-a0c6-7dd1b2968f7f req-55640ef2-1633-43e4-961b-8b2115990966 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027818 Apr 12 03:51:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 299/897] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d3c49632-3ca8-4521-8412-c8d9ec4f7cd2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.319074 Apr 12 03:51:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 300/898] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:51:23 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/os-interface => generated 282 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:25 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-44061d10-dead-457c-b5f1-4165a0bf7b0c tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068631 Apr 12 03:51:25 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 300/899] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:51:25 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:51:25 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=5 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:25 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=9 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:25 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-bb008382-ee21-42a6-8177-388679f1822d req-1322bf02-0d0c-4f15-8d06-2794afd9b0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bb008382-ee21-42a6-8177-388679f1822d req-1322bf02-0d0c-4f15-8d06-2794afd9b0fe service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bb008382-ee21-42a6-8177-388679f1822d req-1322bf02-0d0c-4f15-8d06-2794afd9b0fe service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bb008382-ee21-42a6-8177-388679f1822d req-1322bf02-0d0c-4f15-8d06-2794afd9b0fe service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-bb008382-ee21-42a6-8177-388679f1822d req-1322bf02-0d0c-4f15-8d06-2794afd9b0fe service nova] Creating event network-changed:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:51:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-bb008382-ee21-42a6-8177-388679f1822d req-1322bf02-0d0c-4f15-8d06-2794afd9b0fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036566 Apr 12 03:51:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 300/900] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-4dc72ca9-8eff-4af4-a124-239c1b9f0a7c req-8b82c91a-7e97-4d4e-b167-9c420abdacd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4dc72ca9-8eff-4af4-a124-239c1b9f0a7c req-8b82c91a-7e97-4d4e-b167-9c420abdacd3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4dc72ca9-8eff-4af4-a124-239c1b9f0a7c req-8b82c91a-7e97-4d4e-b167-9c420abdacd3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-4dc72ca9-8eff-4af4-a124-239c1b9f0a7c req-8b82c91a-7e97-4d4e-b167-9c420abdacd3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-4dc72ca9-8eff-4af4-a124-239c1b9f0a7c req-8b82c91a-7e97-4d4e-b167-9c420abdacd3 service nova] Creating event network-changed:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:51:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-4dc72ca9-8eff-4af4-a124-239c1b9f0a7c req-8b82c91a-7e97-4d4e-b167-9c420abdacd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033311 Apr 12 03:51:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 301/901] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:51:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-85c0f37c-49ec-4d85-9bbd-c93e02435c44 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1427 microversion: 2.1 time: 0.222603 Apr 12 03:51:26 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 301/902] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:25 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3dae7b58-3cfb-4af3-ad0d-41ec282b04b8 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076" status: 204 len: 0 microversion: 2.1 time: 0.121835 Apr 12 03:51:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 301/903] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:51:26 2023] DELETE /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:51:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-3b9b3339-c69f-4a49-91a1-556aaeed85d1 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076" status: 200 len: 1661 microversion: 2.1 time: 0.187789 Apr 12 03:51:26 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 302/904] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:26 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 => generated 1661 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Old instance type m1.nano, new instance type m1.micro {{(pid=62074) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Getting quotas for user a7f422f1a05a4a92ba387e424850b360 and project 815b65aa5ad9442db0a087c646f96bbd. Resources: {'ram', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:51:26 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7a38f38d-b3d9-4fdb-9432-883add953c70 req-c6c9e39a-ebe7-4fde-9358-544483d8d2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "name": "network-vif-unplugged", "status": "completed", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7a38f38d-b3d9-4fdb-9432-883add953c70 req-c6c9e39a-ebe7-4fde-9358-544483d8d2b3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7a38f38d-b3d9-4fdb-9432-883add953c70 req-c6c9e39a-ebe7-4fde-9358-544483d8d2b3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7a38f38d-b3d9-4fdb-9432-883add953c70 req-c6c9e39a-ebe7-4fde-9358-544483d8d2b3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7a38f38d-b3d9-4fdb-9432-883add953c70 req-c6c9e39a-ebe7-4fde-9358-544483d8d2b3 service nova] Creating event network-vif-unplugged:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:51:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7a38f38d-b3d9-4fdb-9432-883add953c70 req-c6c9e39a-ebe7-4fde-9358-544483d8d2b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036037 Apr 12 03:51:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 302/905] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1ee91188-0132-4d09-8fdc-1cd4eb0de709 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/action" status: 202 len: 0 microversion: 2.1 time: 0.407498 Apr 12 03:51:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 302/906] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:51:26 2023] POST /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:26 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:51:26 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4a306bd5-8554-4839-8e78-3bf6ca57b61e tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1436 microversion: 2.1 time: 0.201405 Apr 12 03:51:26 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 303/907] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:26 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1436 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:51:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}, {"server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "name": "network-vif-deleted", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Creating event network-changed:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:51:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Creating event network-vif-deleted:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:51:27 user devstack@n-api.service[62073]: DEBUG nova.compute.api [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] Instance 65ba7373-1427-409d-9aa7-6cb7894d665b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:51:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-c34a801c-5e2a-461d-ae7b-ad7f39fa5689 req-aca8ee73-1e06-404d-b7a6-343cfcd55af0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041946 Apr 12 03:51:27 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 303/908] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:28 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-716d5b53-48c6-4c89-935d-fcc3d924b75a req-a301d001-0176-4489-bab9-1fe38489a9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d7d43b-ac65-4ebf-9645-b17e61397076", "name": "network-vif-plugged", "status": "completed", "tag": "7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-716d5b53-48c6-4c89-935d-fcc3d924b75a req-a301d001-0176-4489-bab9-1fe38489a9e4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-716d5b53-48c6-4c89-935d-fcc3d924b75a req-a301d001-0176-4489-bab9-1fe38489a9e4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:28 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-716d5b53-48c6-4c89-935d-fcc3d924b75a req-a301d001-0176-4489-bab9-1fe38489a9e4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-716d5b53-48c6-4c89-935d-fcc3d924b75a req-a301d001-0176-4489-bab9-1fe38489a9e4 service nova] Creating event network-vif-plugged:7f861491-1d4d-4ff0-a1c8-8b0a8ebc7913 for instance a6d7d43b-ac65-4ebf-9645-b17e61397076 on user Apr 12 03:51:28 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-716d5b53-48c6-4c89-935d-fcc3d924b75a req-a301d001-0176-4489-bab9-1fe38489a9e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Apr 12 03:51:28 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 303/909] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:28 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:28 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d91d2e1b-c09d-4dd9-8749-a312d97deb3b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050092 Apr 12 03:51:28 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 304/910] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:51:28 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:29 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:51:29 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-af8b5981-3539-4117-aafa-3e5000ab6bb8 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 204 len: 0 microversion: 2.1 time: 0.127484 Apr 12 03:51:29 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 304/911] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:51:29 2023] DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:29 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-94df2e24-bfec-4f75-9ba9-d7ee54927ad6 req-8d352d35-22ec-4205-96ed-747719dade14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-unplugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-94df2e24-bfec-4f75-9ba9-d7ee54927ad6 req-8d352d35-22ec-4205-96ed-747719dade14 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-94df2e24-bfec-4f75-9ba9-d7ee54927ad6 req-8d352d35-22ec-4205-96ed-747719dade14 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:29 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-94df2e24-bfec-4f75-9ba9-d7ee54927ad6 req-8d352d35-22ec-4205-96ed-747719dade14 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:29 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-94df2e24-bfec-4f75-9ba9-d7ee54927ad6 req-8d352d35-22ec-4205-96ed-747719dade14 service nova] Creating event network-vif-unplugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:29 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-94df2e24-bfec-4f75-9ba9-d7ee54927ad6 req-8d352d35-22ec-4205-96ed-747719dade14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034265 Apr 12 03:51:29 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 305/912] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:29 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:51:29 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9f2384ca-6b03-45c2-b6a4-1a7f907e027d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 200 len: 1663 microversion: 2.1 time: 0.581229 Apr 12 03:51:29 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 304/913] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:29 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 1663 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:51:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}, {"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-plugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-unplugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}, {"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-plugged", "status": "completed", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-unplugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-plugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-unplugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Creating event network-vif-plugged:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] Instance 65ba7373-1427-409d-9aa7-6cb7894d665b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:51:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-7076d93b-fdaf-4477-bc74-372c4ef7b638 req-aa28b49b-3f0f-4665-8420-2f1e7f5acfd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1213 microversion: 2.1 time: 0.047637 Apr 12 03:51:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 305/914] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 03:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 1213 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:51:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c7c08b5c-3a51-4f20-81f5-12c2d3159e27 req-ebec080a-1cae-4492-8686-6fc331aa0658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606425bb-8968-41f9-b3a5-80b6fd188a67", "name": "network-vif-deleted", "tag": "e16af111-f1d4-4f8c-a67a-c80f546c37b1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c7c08b5c-3a51-4f20-81f5-12c2d3159e27 req-ebec080a-1cae-4492-8686-6fc331aa0658 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c7c08b5c-3a51-4f20-81f5-12c2d3159e27 req-ebec080a-1cae-4492-8686-6fc331aa0658 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c7c08b5c-3a51-4f20-81f5-12c2d3159e27 req-ebec080a-1cae-4492-8686-6fc331aa0658 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:31 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c7c08b5c-3a51-4f20-81f5-12c2d3159e27 req-ebec080a-1cae-4492-8686-6fc331aa0658 service nova] Creating event network-vif-deleted:e16af111-f1d4-4f8c-a67a-c80f546c37b1 for instance 606425bb-8968-41f9-b3a5-80b6fd188a67 on user Apr 12 03:51:31 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c7c08b5c-3a51-4f20-81f5-12c2d3159e27 req-ebec080a-1cae-4492-8686-6fc331aa0658 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028159 Apr 12 03:51:31 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 306/915] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-plugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=22 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] Creating event network-vif-plugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:51:40 user devstack@n-api.service[62074]: DEBUG nova.compute.api [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] Instance 65ba7373-1427-409d-9aa7-6cb7894d665b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62074) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:51:40 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-85565830-0fb6-4b31-a56c-d3d3bf146cc0 req-cd882521-3b80-427d-a4ba-875b186dc81c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051157 Apr 12 03:51:40 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 305/916] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-42cadbd0-5630-4604-9e68-27e01973c851 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060527 Apr 12 03:51:41 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 306/917] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:51:41 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:51:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-685cf456-4a51-4fca-979e-1789f96853bf tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 204 len: 0 microversion: 2.1 time: 0.119265 Apr 12 03:51:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 307/918] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:51:41 2023] DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-plugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:42 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd52637cca2114e5e99e688ee371c835a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13546149a4e44e1b782b99e9eb452e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:51:42 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-99ee5017-beb9-4873-af8a-647e1678e8ac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 200 len: 1669 microversion: 2.1 time: 0.243666 Apr 12 03:51:42 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 306/919] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:41 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:51:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] Creating event network-vif-plugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:51:42 user devstack@n-api.service[62073]: DEBUG nova.compute.api [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] Instance 65ba7373-1427-409d-9aa7-6cb7894d665b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 03:51:42 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f1c4f97c-d352-4abe-9995-76e66c6b8118 req-ecc68321-6c36-4052-96f4-69077868fa0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062426 Apr 12 03:51:42 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 307/920] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:43 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-cd636a47-c68b-4a82-a830-58b197a4194f req-8b05ca88-352b-43d8-8b36-931ca1090c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "name": "network-vif-deleted", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cd636a47-c68b-4a82-a830-58b197a4194f req-8b05ca88-352b-43d8-8b36-931ca1090c8a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cd636a47-c68b-4a82-a830-58b197a4194f req-8b05ca88-352b-43d8-8b36-931ca1090c8a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-cd636a47-c68b-4a82-a830-58b197a4194f req-8b05ca88-352b-43d8-8b36-931ca1090c8a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-cd636a47-c68b-4a82-a830-58b197a4194f req-8b05ca88-352b-43d8-8b36-931ca1090c8a service nova] Creating event network-vif-deleted:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:51:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-cd636a47-c68b-4a82-a830-58b197a4194f req-8b05ca88-352b-43d8-8b36-931ca1090c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034566 Apr 12 03:51:43 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 308/921] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "name": "network-vif-unplugged", "status": "completed", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}, {"server_uuid": "93a2f40a-1eae-4986-b418-ddbf45723196", "name": "network-vif-plugged", "status": "completed", "tag": "7afd2456-5a12-4283-8760-46d4c7fe8ad1"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:51:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] Creating event network-vif-unplugged:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:51:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] Creating event network-vif-plugged:7afd2456-5a12-4283-8760-46d4c7fe8ad1 for instance 93a2f40a-1eae-4986-b418-ddbf45723196 on user Apr 12 03:51:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-6ea8a2ff-7add-44de-a588-0cf0cdd15b19 req-8f83f3fd-af5e-41ac-bed7-8be05f7f9fa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034950 Apr 12 03:51:44 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 307/922] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:51:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 12351dbd-0f2e-40a6-a10a-f40f5b6250ef] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef could not be found. Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:51:48 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef HTTP/1.1 Apr 12 03:51:48 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:51:48 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:51:48 user devstack@n-api.service[62073]: Connection: close Apr 12 03:51:48 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:51:48 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:51:48 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:51:48 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:51:48 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:51:48 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:48 user devstack@n-api.service[62073]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:51:48 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:51:48 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:51:48 user devstack@n-api.service[62073]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:51:48 user devstack@n-api.service[62073]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:51:48 user devstack@n-api.service[62073]: method: > Apr 12 03:51:48 user devstack@n-api.service[62073]: exception: Instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef could not be found. Apr 12 03:51:48 user devstack@n-api.service[62073]: action_args: {'id': '12351dbd-0f2e-40a6-a10a-f40f5b6250ef'} Apr 12 03:51:48 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef could not be found. Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef could not be found. Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef could not be found. Apr 12 03:51:48 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:51:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 12351dbd-0f2e-40a6-a10a-f40f5b6250ef could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:51:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-18518e6d-05f6-4aa6-b0b2-80aee897c14b tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef" status: 404 len: 111 microversion: 2.1 time: 0.231683 Apr 12 03:51:48 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 308/923] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:48 2023] GET /compute/v2.1/servers/12351dbd-0f2e-40a6-a10a-f40f5b6250ef => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:51:49 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e HTTP/1.1 Apr 12 03:51:49 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:51:49 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:51:49 user devstack@n-api.service[62072]: Connection: close Apr 12 03:51:49 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:51:49 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:51:49 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:51:49 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:51:49 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:51:49 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:49 user devstack@n-api.service[62072]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:51:49 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:51:49 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:51:49 user devstack@n-api.service[62072]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:51:49 user devstack@n-api.service[62072]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:51:49 user devstack@n-api.service[62072]: method: > Apr 12 03:51:49 user devstack@n-api.service[62072]: exception: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62072]: action_args: {'id': '93e45116-bb5c-40ca-9fc5-1c5c40ff687e'} Apr 12 03:51:49 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:51:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-105614a3-9c33-41a5-95d8-0616967cd3a3 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 404 len: 111 microversion: 2.1 time: 0.028637 Apr 12 03:51:49 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 309/924] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:51:49 2023] DELETE /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] [instance: 93e45116-bb5c-40ca-9fc5-1c5c40ff687e] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:51:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] HTTP exception thrown: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Request method failure captured: Apr 12 03:51:49 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e HTTP/1.1 Apr 12 03:51:49 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:51:49 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:51:49 user devstack@n-api.service[62074]: Connection: close Apr 12 03:51:49 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:51:49 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:51:49 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:51:49 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:51:49 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNibbaKl5tBupWhK5iwp13ilTQRoLrH7ITwC4EPLSHeKsRR6__oMB-kXH9aZZvTgU384SQ7iRzOAayLWkSkFAHXMiVuJvDV9kViSe4bSHd3YW9DKyKBHCxpiShWFiYB5UBsQXYzjAJ4y0bm8Zaj6b5XP7XE76vEPhcGniMEm2u1DNfhw Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Project-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/003688353e2f4b36831c574ebaf65173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/003688353e2f4b36831c574ebaf65173"}]}] Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Tenant: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Tenant-Id: 003688353e2f4b36831c574ebaf65173 Apr 12 03:51:49 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestVolumeBootPattern-235043461 Apr 12 03:51:49 user devstack@n-api.service[62074]: X-User: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:51:49 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:51:49 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:51:49 user devstack@n-api.service[62074]: X-User-Id: b00b348933224558aad1cb12921f100f Apr 12 03:51:49 user devstack@n-api.service[62074]: X-User-Name: tempest-TestVolumeBootPattern-235043461-project-member Apr 12 03:51:49 user devstack@n-api.service[62074]: method: > Apr 12 03:51:49 user devstack@n-api.service[62074]: exception: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62074]: action_args: {'id': '93e45116-bb5c-40ca-9fc5-1c5c40ff687e'} Apr 12 03:51:49 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. Apr 12 03:51:49 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:51:49 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Returning 404 to user: Instance 93e45116-bb5c-40ca-9fc5-1c5c40ff687e could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:51:49 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-2374344e-13cc-4699-bd5d-d25f3e2328e0 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e" status: 404 len: 111 microversion: 2.1 time: 0.028297 Apr 12 03:51:49 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 308/925] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:51:49 2023] GET /compute/v2.1/servers/93e45116-bb5c-40ca-9fc5-1c5c40ff687e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:51:51 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-81b62c67-bd2c-443d-99ad-5c897351c593 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] Calling method '.version_select at 0x7f76a6ff1900>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:51:51 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-81b62c67-bd2c-443d-99ad-5c897351c593 tempest-TestVolumeBootPattern-235043461 tempest-TestVolumeBootPattern-235043461-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-54080024" status: 202 len: 0 microversion: 2.1 time: 0.025690 Apr 12 03:51:51 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 309/926] 10.0.0.210 () {62 vars in 1334 bytes} [Wed Apr 12 03:51:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-54080024 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: a6d7d43b-ac65-4ebf-9645-b17e61397076] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] HTTP exception thrown: Instance a6d7d43b-ac65-4ebf-9645-b17e61397076 could not be found. Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Request method failure captured: Apr 12 03:52:16 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 HTTP/1.1 Apr 12 03:52:16 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:52:16 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:52:16 user devstack@n-api.service[62072]: Connection: close Apr 12 03:52:16 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:52:16 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:52:16 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:52:16 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:52:16 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNilP9jTpnGHjWCnOPNJcVtT44FvtcVErs2cBw5FXNoq_0et-i8WxrC8UqWnNFJfVX_H1pumQFisrajueYKPRFP6uav8JAiOENzFB_jkpkRnNMF-bTSgZtWkkw-vaKXvT5ClVP8rn_RH8GaMDLKPQFTzcUrNl038-femET26oycS9nyE Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Project-Id: c426e52304c14ed9b0c1aed69691bc3d Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestStampPattern-707517070 Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c426e52304c14ed9b0c1aed69691bc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c426e52304c14ed9b0c1aed69691bc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c426e52304c14ed9b0c1aed69691bc3d"}]}] Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Tenant: tempest-TestStampPattern-707517070 Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Tenant-Id: c426e52304c14ed9b0c1aed69691bc3d Apr 12 03:52:16 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestStampPattern-707517070 Apr 12 03:52:16 user devstack@n-api.service[62072]: X-User: tempest-TestStampPattern-707517070-project-member Apr 12 03:52:16 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:52:16 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:52:16 user devstack@n-api.service[62072]: X-User-Id: 88c496d8e488434e833e67df25def576 Apr 12 03:52:16 user devstack@n-api.service[62072]: X-User-Name: tempest-TestStampPattern-707517070-project-member Apr 12 03:52:16 user devstack@n-api.service[62072]: method: > Apr 12 03:52:16 user devstack@n-api.service[62072]: exception: Instance a6d7d43b-ac65-4ebf-9645-b17e61397076 could not be found. Apr 12 03:52:16 user devstack@n-api.service[62072]: action_args: {'id': 'a6d7d43b-ac65-4ebf-9645-b17e61397076'} Apr 12 03:52:16 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d7d43b-ac65-4ebf-9645-b17e61397076 could not be found. Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d7d43b-ac65-4ebf-9645-b17e61397076 could not be found. Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d7d43b-ac65-4ebf-9645-b17e61397076 could not be found. Apr 12 03:52:16 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Returning 404 to user: Instance a6d7d43b-ac65-4ebf-9645-b17e61397076 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b8570c0f-bbe1-4474-876c-662a2a5de568 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076" status: 404 len: 111 microversion: 2.1 time: 0.043611 Apr 12 03:52:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 310/927] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:16 2023] GET /compute/v2.1/servers/a6d7d43b-ac65-4ebf-9645-b17e61397076 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=14 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:17 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:52:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-bd3ceb69-d6ef-4f5c-878c-31bc3ba7554f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1554 microversion: 2.1 time: 0.179647 Apr 12 03:52:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 309/928] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:16 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] HTTP exception thrown: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Request method failure captured: Apr 12 03:52:19 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 HTTP/1.1 Apr 12 03:52:19 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:52:19 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:52:19 user devstack@n-api.service[62073]: Connection: close Apr 12 03:52:19 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:52:19 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:52:19 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:52:19 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:52:19 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiiHXD3bj-_gmY-MjT9lxk3uZSAt86iIoSEV8VJ-AZeoBSPFglxAqXpOki4DN0dF0yIUFZ9JdftG3L4UY7frKVv1ACxUzjwt_zJb18C9V1v47GN8Gn_wFLXOo4EVBwK-3cOgnBWNHKJ5kXooAE0O7vKi1TMgLnfRnsmmPdBSy_e0-Lg Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Project-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a341e582192a47548df8627d82c96ea8"}]}] Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Tenant-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:52:19 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:52:19 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:52:19 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:52:19 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:52:19 user devstack@n-api.service[62073]: X-User-Id: 872fbc3d59274cd480c17b4b7342499a Apr 12 03:52:19 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:52:19 user devstack@n-api.service[62073]: method: > Apr 12 03:52:19 user devstack@n-api.service[62073]: exception: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:52:19 user devstack@n-api.service[62073]: action_args: {'id': '606425bb-8968-41f9-b3a5-80b6fd188a67'} Apr 12 03:52:19 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:52:19 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:19 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Returning 404 to user: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-192074dc-b847-4b37-ba28-494fb563877e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 404 len: 111 microversion: 2.1 time: 0.040340 Apr 12 03:52:19 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 310/929] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:19 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:19 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-e50b5990-86d7-4b03-a884-cf64132ab05d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '.version_select at 0x7f76a6bed7e0>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:19 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-e50b5990-86d7-4b03-a884-cf64132ab05d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-611227490" status: 202 len: 0 microversion: 2.1 time: 0.021733 Apr 12 03:52:19 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 311/930] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:52:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-611227490 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] HTTP exception thrown: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed is not attached to volume ce7f211d-d195-4fd9-936a-eb3ce8c33470 Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Request method failure captured: Apr 12 03:52:20 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments/ce7f211d-d195-4fd9-936a-eb3ce8c33470 HTTP/1.1 Apr 12 03:52:20 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:52:20 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:52:20 user devstack@n-api.service[62074]: Connection: close Apr 12 03:52:20 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:52:20 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:52:20 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:52:20 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:52:20 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNilP9jTpnGHjWCnOPNJcVtT44FvtcVErs2cBw5FXNoq_0et-i8WxrC8UqWnNFJfVX_H1pumQFisrajueYKPRFP6uav8JAiOENzFB_jkpkRnNMF-bTSgZtWkkw-vaKXvT5ClVP8rn_RH8GaMDLKPQFTzcUrNl038-femET26oycS9nyE Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Project-Id: c426e52304c14ed9b0c1aed69691bc3d Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Project-Name: tempest-TestStampPattern-707517070 Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c426e52304c14ed9b0c1aed69691bc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c426e52304c14ed9b0c1aed69691bc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c426e52304c14ed9b0c1aed69691bc3d"}]}] Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Tenant: tempest-TestStampPattern-707517070 Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Tenant-Id: c426e52304c14ed9b0c1aed69691bc3d Apr 12 03:52:20 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-TestStampPattern-707517070 Apr 12 03:52:20 user devstack@n-api.service[62074]: X-User: tempest-TestStampPattern-707517070-project-member Apr 12 03:52:20 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:52:20 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:52:20 user devstack@n-api.service[62074]: X-User-Id: 88c496d8e488434e833e67df25def576 Apr 12 03:52:20 user devstack@n-api.service[62074]: X-User-Name: tempest-TestStampPattern-707517070-project-member Apr 12 03:52:20 user devstack@n-api.service[62074]: method: > Apr 12 03:52:20 user devstack@n-api.service[62074]: exception: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed is not attached to volume ce7f211d-d195-4fd9-936a-eb3ce8c33470 Apr 12 03:52:20 user devstack@n-api.service[62074]: action_args: {'server_id': '7c2344ea-3ed4-40f5-b318-6fa8588b1fed', 'id': 'ce7f211d-d195-4fd9-936a-eb3ce8c33470'} Apr 12 03:52:20 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ce7f211d-d195-4fd9-936a-eb3ce8c33470. Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed is not attached to volume ce7f211d-d195-4fd9-936a-eb3ce8c33470 Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed is not attached to volume ce7f211d-d195-4fd9-936a-eb3ce8c33470 Apr 12 03:52:20 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Returning 404 to user: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed is not attached to volume ce7f211d-d195-4fd9-936a-eb3ce8c33470 {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-41d4fd28-4d3f-43b9-ad69-cdb5fd50ca2f tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments/ce7f211d-d195-4fd9-936a-eb3ce8c33470" status: 404 len: 154 microversion: 2.1 time: 0.130922 Apr 12 03:52:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 310/931] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:52:20 2023] DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed/os-volume_attachments/ce7f211d-d195-4fd9-936a-eb3ce8c33470 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-75dfe9d6-7d40-421a-80a0-370cf1990f92 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: .version_select at 0x7f76a696c280>, body: {"keypair": {"name": "tempest-keypair-1939295877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5dfRZfMAh+PjjlIpXMM5gTNQ/AVHmZ6QANnWldIoSsGeWR4SRx5i4ef7EgAPnNzMv6qe56Q5J7su4WXqBoiAy/S0b9fCrjSIUZQ+BsTnQye+GfEYaIPsBJDEmU+yv9Hw=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-75dfe9d6-7d40-421a-80a0-370cf1990f92 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for project a341e582192a47548df8627d82c96ea8. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-75dfe9d6-7d40-421a-80a0-370cf1990f92 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for user 872fbc3d59274cd480c17b4b7342499a and project a341e582192a47548df8627d82c96ea8. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:52:20 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-75dfe9d6-7d40-421a-80a0-370cf1990f92 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044366 Apr 12 03:52:20 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 311/932] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:52:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-f572d2b0-12ea-4460-9a4e-1d836086945d req-bd9815ab-1a91-496d-865d-ca4bbfd66492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f572d2b0-12ea-4460-9a4e-1d836086945d req-bd9815ab-1a91-496d-865d-ca4bbfd66492 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f572d2b0-12ea-4460-9a4e-1d836086945d req-bd9815ab-1a91-496d-865d-ca4bbfd66492 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f572d2b0-12ea-4460-9a4e-1d836086945d req-bd9815ab-1a91-496d-865d-ca4bbfd66492 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:20 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:52:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f572d2b0-12ea-4460-9a4e-1d836086945d req-bd9815ab-1a91-496d-865d-ca4bbfd66492 service nova] Creating event network-changed:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:52:20 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-f572d2b0-12ea-4460-9a4e-1d836086945d req-bd9815ab-1a91-496d-865d-ca4bbfd66492 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046339 Apr 12 03:52:20 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 311/933] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:52:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:20 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-dbc16410-2bf7-4d13-b293-ff8f3a52be06 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed" status: 204 len: 0 microversion: 2.1 time: 0.116108 Apr 12 03:52:20 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 312/934] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:52:20 2023] DELETE /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:20 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:21 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c496d8e488434e833e67df25def576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c426e52304c14ed9b0c1aed69691bc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:52:21 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-e0676685-abab-417a-9d80-b3890f850393 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed" status: 200 len: 1661 microversion: 2.1 time: 0.457511 Apr 12 03:52:21 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 312/935] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:20 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed => generated 1661 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 03:52:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-efc1bf56-efae-4bc4-9f87-38060428bfd7 req-eb26d342-4fdf-4ae4-a90e-5922c13335de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "name": "network-vif-unplugged", "status": "completed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-efc1bf56-efae-4bc4-9f87-38060428bfd7 req-eb26d342-4fdf-4ae4-a90e-5922c13335de service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-efc1bf56-efae-4bc4-9f87-38060428bfd7 req-eb26d342-4fdf-4ae4-a90e-5922c13335de service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-efc1bf56-efae-4bc4-9f87-38060428bfd7 req-eb26d342-4fdf-4ae4-a90e-5922c13335de service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-efc1bf56-efae-4bc4-9f87-38060428bfd7 req-eb26d342-4fdf-4ae4-a90e-5922c13335de service nova] Creating event network-vif-unplugged:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:52:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-efc1bf56-efae-4bc4-9f87-38060428bfd7 req-eb26d342-4fdf-4ae4-a90e-5922c13335de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034053 Apr 12 03:52:21 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 312/936] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:52:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1419019551", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4bee7b8b-6409-4a1e-ab1e-480450f73fe5"}], "security_groups": [{"name": "tempest-securitygroup--14750818"}], "key_name": "tempest-keypair-1939295877", "user_data": "}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] validate_networks() for [('4bee7b8b-6409-4a1e-ab1e-480450f73fe5', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for project a341e582192a47548df8627d82c96ea8. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Getting quotas for user 872fbc3d59274cd480c17b4b7342499a and project a341e582192a47548df8627d82c96ea8. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:52:22 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:52:22 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b3c8527e-44b6-47aa-b80b-f0185dde6575 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.789237 Apr 12 03:52:22 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 313/937] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:52:22 2023] POST /compute/v2.1/servers => generated 398 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:52:22 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a4155a65-4ce0-49bb-ad7c-e4db4d9f8957 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:22 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a4155a65-4ce0-49bb-ad7c-e4db4d9f8957 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:22 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-a4155a65-4ce0-49bb-ad7c-e4db4d9f8957 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:52:22 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a4155a65-4ce0-49bb-ad7c-e4db4d9f8957 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 200 len: 1232 microversion: 2.1 time: 0.075162 Apr 12 03:52:22 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 313/938] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:22 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 1232 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:52:23 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "name": "network-vif-plugged", "status": "completed", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}, {"server_uuid": "7c2344ea-3ed4-40f5-b318-6fa8588b1fed", "name": "network-vif-deleted", "tag": "c2ac7de8-155e-4d88-8534-5a5291bd18dc"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:23 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] Creating event network-vif-plugged:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:52:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] Creating event network-vif-deleted:c2ac7de8-155e-4d88-8534-5a5291bd18dc for instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed on user Apr 12 03:52:23 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-7ff5b304-32c3-4007-8f0e-b457dc6ff050 req-839d9390-9db2-4c44-bc9d-5e6f2fc044b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030585 Apr 12 03:52:23 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 313/939] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:52:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-6886d3ae-5f34-4010-833e-64f461485936 req-fb30a602-03ef-4952-a85e-7abc4e71f591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6886d3ae-5f34-4010-833e-64f461485936 req-fb30a602-03ef-4952-a85e-7abc4e71f591 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6886d3ae-5f34-4010-833e-64f461485936 req-fb30a602-03ef-4952-a85e-7abc4e71f591 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6886d3ae-5f34-4010-833e-64f461485936 req-fb30a602-03ef-4952-a85e-7abc4e71f591 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-6886d3ae-5f34-4010-833e-64f461485936 req-fb30a602-03ef-4952-a85e-7abc4e71f591 service nova] Creating event network-changed:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:52:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-6886d3ae-5f34-4010-833e-64f461485936 req-fb30a602-03ef-4952-a85e-7abc4e71f591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038027 Apr 12 03:52:25 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 314/940] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-57b550ba-1062-418e-a2e0-55735c1ab936 req-155c3a10-780d-445f-b805-4cf56f2edba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "name": "network-vif-plugged", "status": "completed", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-57b550ba-1062-418e-a2e0-55735c1ab936 req-155c3a10-780d-445f-b805-4cf56f2edba3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-57b550ba-1062-418e-a2e0-55735c1ab936 req-155c3a10-780d-445f-b805-4cf56f2edba3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-57b550ba-1062-418e-a2e0-55735c1ab936 req-155c3a10-780d-445f-b805-4cf56f2edba3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-57b550ba-1062-418e-a2e0-55735c1ab936 req-155c3a10-780d-445f-b805-4cf56f2edba3 service nova] Creating event network-vif-plugged:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:52:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-57b550ba-1062-418e-a2e0-55735c1ab936 req-155c3a10-780d-445f-b805-4cf56f2edba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174969 Apr 12 03:52:27 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 314/941] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:30 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-07a1af10-4249-47c4-b3f7-81aa0a7ee7f3 req-d910c725-a414-49d4-9ff2-fd5bc4298f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "name": "network-vif-plugged", "status": "completed", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:52:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-07a1af10-4249-47c4-b3f7-81aa0a7ee7f3 req-d910c725-a414-49d4-9ff2-fd5bc4298f54 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-07a1af10-4249-47c4-b3f7-81aa0a7ee7f3 req-d910c725-a414-49d4-9ff2-fd5bc4298f54 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:30 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-07a1af10-4249-47c4-b3f7-81aa0a7ee7f3 req-d910c725-a414-49d4-9ff2-fd5bc4298f54 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-07a1af10-4249-47c4-b3f7-81aa0a7ee7f3 req-d910c725-a414-49d4-9ff2-fd5bc4298f54 service nova] Creating event network-vif-plugged:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:52:30 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-07a1af10-4249-47c4-b3f7-81aa0a7ee7f3 req-d910c725-a414-49d4-9ff2-fd5bc4298f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Apr 12 03:52:30 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 314/942] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:52:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:32 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 HTTP/1.1 Apr 12 03:52:32 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:52:32 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:52:32 user devstack@n-api.service[62072]: Connection: close Apr 12 03:52:32 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:52:32 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:52:32 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:52:32 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:52:32 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:32 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:32 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:32 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:52:32 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:52:32 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:32 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:32 user devstack@n-api.service[62072]: method: > Apr 12 03:52:32 user devstack@n-api.service[62072]: exception: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:32 user devstack@n-api.service[62072]: action_args: {'id': '93a2f40a-1eae-4986-b418-ddbf45723196'} Apr 12 03:52:32 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:32 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:32 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:32 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f50ed2c9-30d2-4774-a2ab-0a25d4d5f0fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 404 len: 111 microversion: 2.1 time: 0.036097 Apr 12 03:52:32 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 315/943] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:32 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:32 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6fe9847b-2fb8-421b-ba50-22ab3fa239fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '.version_select at 0x7f76a696e8c0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:32 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6fe9847b-2fb8-421b-ba50-22ab3fa239fc tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422441298" status: 202 len: 0 microversion: 2.1 time: 0.028433 Apr 12 03:52:32 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 315/944] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:52:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422441298 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:35 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 HTTP/1.1 Apr 12 03:52:35 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:52:35 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:52:35 user devstack@n-api.service[62074]: Connection: close Apr 12 03:52:35 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:52:35 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:52:35 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:52:35 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:52:35 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:35 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:35 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:35 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:52:35 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:52:35 user devstack@n-api.service[62074]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:35 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:35 user devstack@n-api.service[62074]: method: > Apr 12 03:52:35 user devstack@n-api.service[62074]: exception: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62074]: action_args: {'id': '93a2f40a-1eae-4986-b418-ddbf45723196'} Apr 12 03:52:35 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-dd8619a0-630c-4dd4-84e7-7658a5289566 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 404 len: 111 microversion: 2.1 time: 0.035549 Apr 12 03:52:35 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 315/945] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:52:35 2023] DELETE /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 93a2f40a-1eae-4986-b418-ddbf45723196] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:35 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 HTTP/1.1 Apr 12 03:52:35 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:52:35 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:52:35 user devstack@n-api.service[62072]: Connection: close Apr 12 03:52:35 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:52:35 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:52:35 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:52:35 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:52:35 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:35 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:35 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:35 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:52:35 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:52:35 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:35 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:35 user devstack@n-api.service[62072]: method: > Apr 12 03:52:35 user devstack@n-api.service[62072]: exception: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62072]: action_args: {'id': '93a2f40a-1eae-4986-b418-ddbf45723196'} Apr 12 03:52:35 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. Apr 12 03:52:35 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance 93a2f40a-1eae-4986-b418-ddbf45723196 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-aad24ec3-7b5f-4b03-9d03-aa2b09097cac tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196" status: 404 len: 111 microversion: 2.1 time: 0.032783 Apr 12 03:52:35 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 316/946] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:35 2023] GET /compute/v2.1/servers/93a2f40a-1eae-4986-b418-ddbf45723196 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:37 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 HTTP/1.1 Apr 12 03:52:37 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:52:37 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:52:37 user devstack@n-api.service[62073]: Connection: close Apr 12 03:52:37 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:52:37 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:52:37 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:52:37 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:52:37 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62073]: method: > Apr 12 03:52:37 user devstack@n-api.service[62073]: exception: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: action_args: {'id': 'a264f3f7-b0ea-482a-a438-909f06a80726'} Apr 12 03:52:37 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-45463776-4b9a-4619-9e32-268a9d582a87 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 404 len: 111 microversion: 2.1 time: 0.036122 Apr 12 03:52:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 316/947] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:52:37 2023] DELETE /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: a264f3f7-b0ea-482a-a438-909f06a80726] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:37 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 HTTP/1.1 Apr 12 03:52:37 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:52:37 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:52:37 user devstack@n-api.service[62074]: Connection: close Apr 12 03:52:37 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:52:37 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:52:37 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:52:37 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:52:37 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62074]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:37 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62074]: method: > Apr 12 03:52:37 user devstack@n-api.service[62074]: exception: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62074]: action_args: {'id': 'a264f3f7-b0ea-482a-a438-909f06a80726'} Apr 12 03:52:37 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. Apr 12 03:52:37 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance a264f3f7-b0ea-482a-a438-909f06a80726 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d73d9731-3941-4f64-ba06-dae4f3056974 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726" status: 404 len: 111 microversion: 2.1 time: 0.032327 Apr 12 03:52:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 316/948] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:37 2023] GET /compute/v2.1/servers/a264f3f7-b0ea-482a-a438-909f06a80726 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:37 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b HTTP/1.1 Apr 12 03:52:37 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:52:37 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:52:37 user devstack@n-api.service[62072]: Connection: close Apr 12 03:52:37 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:52:37 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:52:37 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:52:37 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:52:37 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:37 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62072]: method: > Apr 12 03:52:37 user devstack@n-api.service[62072]: exception: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62072]: action_args: {'id': '117ea473-f8e3-43c7-8406-d4590422cc0b'} Apr 12 03:52:37 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-15358929-0f03-4567-9acd-f4287225cb17 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 404 len: 111 microversion: 2.1 time: 0.029294 Apr 12 03:52:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 317/949] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:52:37 2023] DELETE /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: 117ea473-f8e3-43c7-8406-d4590422cc0b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:37 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b HTTP/1.1 Apr 12 03:52:37 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:52:37 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:52:37 user devstack@n-api.service[62073]: Connection: close Apr 12 03:52:37 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:52:37 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:52:37 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:52:37 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:52:37 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:37 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:37 user devstack@n-api.service[62073]: method: > Apr 12 03:52:37 user devstack@n-api.service[62073]: exception: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: action_args: {'id': '117ea473-f8e3-43c7-8406-d4590422cc0b'} Apr 12 03:52:37 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. Apr 12 03:52:37 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:52:37 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance 117ea473-f8e3-43c7-8406-d4590422cc0b could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0572f039-2359-49c7-9f5e-231237a517f2 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b" status: 404 len: 111 microversion: 2.1 time: 0.026897 Apr 12 03:52:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 317/950] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:37 2023] GET /compute/v2.1/servers/117ea473-f8e3-43c7-8406-d4590422cc0b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:39 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 HTTP/1.1 Apr 12 03:52:39 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:52:39 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:52:39 user devstack@n-api.service[62074]: Connection: close Apr 12 03:52:39 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:52:39 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:52:39 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:52:39 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:52:39 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:39 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:39 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:39 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:52:39 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:52:39 user devstack@n-api.service[62074]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:39 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:39 user devstack@n-api.service[62074]: method: > Apr 12 03:52:39 user devstack@n-api.service[62074]: exception: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62074]: action_args: {'id': 'f73fa883-75f0-4593-a89c-d009c6d4ebf0'} Apr 12 03:52:39 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d7ec6421-9d6a-4b90-8b8a-0bb3fb5ce90f tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 404 len: 111 microversion: 2.1 time: 0.030294 Apr 12 03:52:39 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 317/951] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:52:39 2023] DELETE /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] [instance: f73fa883-75f0-4593-a89c-d009c6d4ebf0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:52:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] HTTP exception thrown: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Request method failure captured: Apr 12 03:52:39 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 HTTP/1.1 Apr 12 03:52:39 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:52:39 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:52:39 user devstack@n-api.service[62072]: Connection: close Apr 12 03:52:39 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:52:39 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:52:39 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:52:39 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:52:39 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNie3IuOhlkiINYbjLNZ0qJvn7MqPJoCi5qkRGJqkPSU-xTK_4a1qjXn229KV9NX46X2LUz8XkLHq0OansQXqQhB1SkQZh3wiEyTsIla6E5J4qbpvqH0TdM6sgLDbKixQfTz9WIa9YBXKYdlJXgWO6JlOY49LOyDxZSb0EMa7OiWILKI Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Project-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d13546149a4e44e1b782b99e9eb452e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d13546149a4e44e1b782b99e9eb452e8"}]}] Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Tenant-Id: d13546149a4e44e1b782b99e9eb452e8 Apr 12 03:52:39 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-494105310 Apr 12 03:52:39 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:39 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:52:39 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:52:39 user devstack@n-api.service[62072]: X-User-Id: d52637cca2114e5e99e688ee371c835a Apr 12 03:52:39 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeNegativeTest-494105310-project-member Apr 12 03:52:39 user devstack@n-api.service[62072]: method: > Apr 12 03:52:39 user devstack@n-api.service[62072]: exception: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62072]: action_args: {'id': 'f73fa883-75f0-4593-a89c-d009c6d4ebf0'} Apr 12 03:52:39 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. Apr 12 03:52:39 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:52:39 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] Returning 404 to user: Instance f73fa883-75f0-4593-a89c-d009c6d4ebf0 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:52:39 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a91604d2-20b5-43ef-afa8-d802b4cb80f0 tempest-AttachVolumeNegativeTest-494105310 tempest-AttachVolumeNegativeTest-494105310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0" status: 404 len: 111 microversion: 2.1 time: 0.031070 Apr 12 03:52:39 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 318/952] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:52:39 2023] GET /compute/v2.1/servers/f73fa883-75f0-4593-a89c-d009c6d4ebf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:53:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:04 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=14 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ddc80734-c310-4e81-bc9c-30a8f791cedc tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Action: 'create', calling method: .version_select at 0x7f76a696cc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1986276884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHBsGFyn1IfBui/0BXjt7hpTkTH4PsZRTzQ4VM6GFP5pgRYv1Yo7P5WOmhK4SKKnd1P8T0z7p8gKrx3Yxp/sOlxdxioj+WGXT88SaOKal87PVel/g0WojZ8NRP1p7DX/g=="}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:53:04 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-ddc80734-c310-4e81-bc9c-30a8f791cedc tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Getting quotas for project d8ec2318ea05403db924630461ea77e5. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:53:04 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-ddc80734-c310-4e81-bc9c-30a8f791cedc tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Getting quotas for user 447437f9d71b4f8ab0da168f0fca732f and project d8ec2318ea05403db924630461ea77e5. Resources: {'key_pairs'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:53:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ddc80734-c310-4e81-bc9c-30a8f791cedc tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.279768 Apr 12 03:53:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 318/953] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:53:04 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:53:08 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1000809041", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1986276884", "security_groups": [{"name": "tempest-secgroup-smoke-1375266188"}], "networks": [{"uuid": "99c0b9a9-e1b4-43d1-bbbb-66560eca330a"}], "block_device_mapping_v2": [{"uuid": "d6a07e3a-be2a-4191-b1b7-09667064fb02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:53:08 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=18 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:08 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=26 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:08 user devstack@n-api.service[62074]: DEBUG nova.network.neutron [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] validate_networks() for [('99c0b9a9-e1b4-43d1-bbbb-66560eca330a', None, None, None, None, None)] {{(pid=62074) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Flavor limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Image limits 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Flavor pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Image pref 0:0:0 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.virt.hardware [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Getting quotas for project d8ec2318ea05403db924630461ea77e5. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Getting quotas for user 447437f9d71b4f8ab0da168f0fca732f and project d8ec2318ea05403db924630461ea77e5. Resources: {'ram', 'instances', 'cores'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Going to run 1 instances... {{(pid=62074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:53:09 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6a07e3a-be2a-4191-b1b7-09667064fb02',volume_size=None,volume_type=None)] {{(pid=62074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:53:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4d2f6ea0-c61a-4db0-bde4-915c975ea9cb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.166085 Apr 12 03:53:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 318/954] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:53:08 2023] POST /compute/v2.1/servers => generated 404 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:53:09 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-12f779ba-7296-4286-8a65-baddfd6c8dbd tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:53:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-12f779ba-7296-4286-8a65-baddfd6c8dbd tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:53:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:09 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-12f779ba-7296-4286-8a65-baddfd6c8dbd tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:53:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-12f779ba-7296-4286-8a65-baddfd6c8dbd tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1084 microversion: 2.1 time: 0.081002 Apr 12 03:53:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 319/955] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:53:09 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1084 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] [instance: 7c2344ea-3ed4-40f5-b318-6fa8588b1fed] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] HTTP exception thrown: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed could not be found. Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Request method failure captured: Apr 12 03:53:11 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed HTTP/1.1 Apr 12 03:53:11 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:53:11 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:53:11 user devstack@n-api.service[62073]: Connection: close Apr 12 03:53:11 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:53:11 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:53:11 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:53:11 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:53:11 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNilP9jTpnGHjWCnOPNJcVtT44FvtcVErs2cBw5FXNoq_0et-i8WxrC8UqWnNFJfVX_H1pumQFisrajueYKPRFP6uav8JAiOENzFB_jkpkRnNMF-bTSgZtWkkw-vaKXvT5ClVP8rn_RH8GaMDLKPQFTzcUrNl038-femET26oycS9nyE Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Project-Id: c426e52304c14ed9b0c1aed69691bc3d Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Project-Name: tempest-TestStampPattern-707517070 Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c426e52304c14ed9b0c1aed69691bc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c426e52304c14ed9b0c1aed69691bc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c426e52304c14ed9b0c1aed69691bc3d"}]}] Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Tenant: tempest-TestStampPattern-707517070 Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Tenant-Id: c426e52304c14ed9b0c1aed69691bc3d Apr 12 03:53:11 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-TestStampPattern-707517070 Apr 12 03:53:11 user devstack@n-api.service[62073]: X-User: tempest-TestStampPattern-707517070-project-member Apr 12 03:53:11 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:53:11 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:53:11 user devstack@n-api.service[62073]: X-User-Id: 88c496d8e488434e833e67df25def576 Apr 12 03:53:11 user devstack@n-api.service[62073]: X-User-Name: tempest-TestStampPattern-707517070-project-member Apr 12 03:53:11 user devstack@n-api.service[62073]: method: > Apr 12 03:53:11 user devstack@n-api.service[62073]: exception: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed could not be found. Apr 12 03:53:11 user devstack@n-api.service[62073]: action_args: {'id': '7c2344ea-3ed4-40f5-b318-6fa8588b1fed'} Apr 12 03:53:11 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed could not be found. Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed could not be found. Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed could not be found. Apr 12 03:53:11 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:53:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Returning 404 to user: Instance 7c2344ea-3ed4-40f5-b318-6fa8588b1fed could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:53:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-0031b95e-2f1a-4bb9-b308-5cadd3b6c7ca tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed" status: 404 len: 111 microversion: 2.1 time: 0.029309 Apr 12 03:53:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 319/956] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:53:11 2023] GET /compute/v2.1/servers/7c2344ea-3ed4-40f5-b318-6fa8588b1fed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:53:12 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-65fea8e4-fdce-4532-a65a-4eefb75dc5ea req-0b4e498f-7c71-41da-9ca4-19eae2424627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:53:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-65fea8e4-fdce-4532-a65a-4eefb75dc5ea req-0b4e498f-7c71-41da-9ca4-19eae2424627 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-65fea8e4-fdce-4532-a65a-4eefb75dc5ea req-0b4e498f-7c71-41da-9ca4-19eae2424627 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:12 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-65fea8e4-fdce-4532-a65a-4eefb75dc5ea req-0b4e498f-7c71-41da-9ca4-19eae2424627 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-65fea8e4-fdce-4532-a65a-4eefb75dc5ea req-0b4e498f-7c71-41da-9ca4-19eae2424627 service nova] Creating event network-changed:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:53:12 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-65fea8e4-fdce-4532-a65a-4eefb75dc5ea req-0b4e498f-7c71-41da-9ca4-19eae2424627 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031434 Apr 12 03:53:12 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 319/957] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:13 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:53:13 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9d92cd03-8e19-4ec1-ba50-474be223721d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 200 len: 1537 microversion: 2.1 time: 0.298301 Apr 12 03:53:13 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 320/958] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:53:13 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 1537 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:53:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-e8586143-0d8d-4df5-932f-9247fc5d4c83 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] Calling method '.version_select at 0x7f76a696c280>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:53:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-e8586143-0d8d-4df5-932f-9247fc5d4c83 tempest-TestStampPattern-707517070 tempest-TestStampPattern-707517070-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-474439147" status: 202 len: 0 microversion: 2.1 time: 0.019814 Apr 12 03:53:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 320/959] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 03:53:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-474439147 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:17 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:17 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-1dd8654d-0753-439b-baa4-fe52888fd4cf tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/action" status: 204 len: 0 microversion: 2.1 time: 0.078519 Apr 12 03:53:17 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 320/960] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:53:17 2023] POST /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:17 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:53:17 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-56d57e40-3cf2-4a0c-a8b4-223d6e658ed5 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1554 microversion: 2.1 time: 0.155647 Apr 12 03:53:17 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 321/961] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:53:17 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:53:19 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:19 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f47ac643-e953-44bd-8a91-6b5170b5e4f1 req-f6d79c9e-adb2-4c38-b7a9-0a65d5bf5659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-plugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:53:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f47ac643-e953-44bd-8a91-6b5170b5e4f1 req-f6d79c9e-adb2-4c38-b7a9-0a65d5bf5659 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f47ac643-e953-44bd-8a91-6b5170b5e4f1 req-f6d79c9e-adb2-4c38-b7a9-0a65d5bf5659 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:19 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f47ac643-e953-44bd-8a91-6b5170b5e4f1 req-f6d79c9e-adb2-4c38-b7a9-0a65d5bf5659 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f47ac643-e953-44bd-8a91-6b5170b5e4f1 req-f6d79c9e-adb2-4c38-b7a9-0a65d5bf5659 service nova] Creating event network-vif-plugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:53:19 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f47ac643-e953-44bd-8a91-6b5170b5e4f1 req-f6d79c9e-adb2-4c38-b7a9-0a65d5bf5659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038902 Apr 12 03:53:19 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 321/962] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:53:21 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:21 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:21 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-2b74ed58-b883-4a81-b265-3c622812b0df req-3f1e2d9b-ec46-4c72-8e71-dc6facb6fb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-plugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:53:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2b74ed58-b883-4a81-b265-3c622812b0df req-3f1e2d9b-ec46-4c72-8e71-dc6facb6fb7f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2b74ed58-b883-4a81-b265-3c622812b0df req-3f1e2d9b-ec46-4c72-8e71-dc6facb6fb7f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:21 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2b74ed58-b883-4a81-b265-3c622812b0df req-3f1e2d9b-ec46-4c72-8e71-dc6facb6fb7f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2b74ed58-b883-4a81-b265-3c622812b0df req-3f1e2d9b-ec46-4c72-8e71-dc6facb6fb7f service nova] Creating event network-vif-plugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:53:21 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-2b74ed58-b883-4a81-b265-3c622812b0df req-3f1e2d9b-ec46-4c72-8e71-dc6facb6fb7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036615 Apr 12 03:53:21 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 321/963] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=12 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:53:59 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:53:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9eba870e-174b-43d0-adb5-7fbcde2dde5f tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1434 microversion: 2.1 time: 0.161097 Apr 12 03:53:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 322/964] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:53:59 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1434 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:07 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:54:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-62757543-6604-4860-a831-30b0e5d909f2 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1546 microversion: 2.1 time: 0.284503 Apr 12 03:54:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 322/965] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:54:07 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-318ff86e-aad1-47a8-b462-88ad505accd4 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.203543 Apr 12 03:54:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 322/966] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 03:54:13 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-interface => generated 283 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:14 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-4ab01cda-3b5e-4701-bb91-d818e08d9363 req-527ed214-5302-41de-8962-8aecfbd070f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:54:14 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:14 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4ab01cda-3b5e-4701-bb91-d818e08d9363 req-527ed214-5302-41de-8962-8aecfbd070f4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4ab01cda-3b5e-4701-bb91-d818e08d9363 req-527ed214-5302-41de-8962-8aecfbd070f4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:14 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4ab01cda-3b5e-4701-bb91-d818e08d9363 req-527ed214-5302-41de-8962-8aecfbd070f4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:14 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4ab01cda-3b5e-4701-bb91-d818e08d9363 req-527ed214-5302-41de-8962-8aecfbd070f4 service nova] Creating event network-changed:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:54:14 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-4ab01cda-3b5e-4701-bb91-d818e08d9363 req-527ed214-5302-41de-8962-8aecfbd070f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034180 Apr 12 03:54:14 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 323/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:54:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:14 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:14 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-de4a6b95-8277-481c-9a5e-4ef39057f1a9 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/ips" status: 200 len: 105 microversion: 2.1 time: 0.039877 Apr 12 03:54:14 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 323/968] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 03:54:14 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/ips => generated 105 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "952561b4-1ccc-4f15-b53b-8fcf4189931e"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:16 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-671c8004-56bc-4125-bf4e-a768d582c946 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272132 Apr 12 03:54:16 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 323/969] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:54:16 2023] POST /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:23 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:23 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b3fefaa4-1d17-4fb7-bf65-645d8e94662a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049882 Apr 12 03:54:23 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 324/970] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:54:23 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:23 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:23 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a1ee2b1a-9f5a-40d5-8bee-685c7386ce0b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/952561b4-1ccc-4f15-b53b-8fcf4189931e" status: 200 len: 194 microversion: 2.1 time: 0.046666 Apr 12 03:54:23 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 324/971] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 03:54:23 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/952561b4-1ccc-4f15-b53b-8fcf4189931e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d2ece15-a8eb-4b1f-b0f5-cf2311fb6611"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-722af097-bccf-4fdc-84ce-9da6c018c117 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717700 Apr 12 03:54:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 324/972] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 03:54:24 2023] POST /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:31 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:31 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-5d90435f-70f5-4c1a-a5c2-df41b787607d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043934 Apr 12 03:54:31 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 325/973] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:54:31 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-84fe217c-2d67-4247-aeb5-fea86d4f3b1a tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/952561b4-1ccc-4f15-b53b-8fcf4189931e" status: 200 len: 194 microversion: 2.1 time: 0.047664 Apr 12 03:54:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 325/974] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 03:54:31 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/952561b4-1ccc-4f15-b53b-8fcf4189931e => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:31 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lazy-loading 'services' on Instance uuid 9a705900-a0de-46e3-9af4-d07911f181c0 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:54:32 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a05beafe-fbc7-4087-be77-c83439e7eb3e tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/952561b4-1ccc-4f15-b53b-8fcf4189931e" status: 202 len: 0 microversion: 2.1 time: 0.153713 Apr 12 03:54:32 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 325/975] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:54:31 2023] DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/952561b4-1ccc-4f15-b53b-8fcf4189931e => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7be1534f-f542-4a44-b61e-957d18898f06 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/3d2ece15-a8eb-4b1f-b0f5-cf2311fb6611" status: 200 len: 194 microversion: 2.1 time: 0.041390 Apr 12 03:54:34 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 326/976] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 03:54:34 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/3d2ece15-a8eb-4b1f-b0f5-cf2311fb6611 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:34 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lazy-loading 'services' on Instance uuid 9a705900-a0de-46e3-9af4-d07911f181c0 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:54:34 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cce5a022-1201-4b66-8183-cc060b307a71 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/3d2ece15-a8eb-4b1f-b0f5-cf2311fb6611" status: 202 len: 0 microversion: 2.1 time: 0.158094 Apr 12 03:54:34 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 326/977] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 03:54:34 2023] DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments/3d2ece15-a8eb-4b1f-b0f5-cf2311fb6611 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:36 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:36 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8b6bbdbf-c81c-434c-b65f-7faf4a8238e6 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045081 Apr 12 03:54:36 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 326/978] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:54:36 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:36 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:36 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-9fd66625-a541-4af5-ac8a-ae2f0fb8d859 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047826 Apr 12 03:54:36 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 327/979] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 03:54:36 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:36 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:54:37 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-da9eecbf-b46e-43ca-b681-1e690ada7113 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 204 len: 0 microversion: 2.1 time: 0.111649 Apr 12 03:54:37 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 327/980] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:54:36 2023] DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:37 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872fbc3d59274cd480c17b4b7342499a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341e582192a47548df8627d82c96ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:54:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-71616984-aa83-48c4-ab94-34843ebb9ef7 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 200 len: 1662 microversion: 2.1 time: 0.177759 Apr 12 03:54:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 327/981] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:54:37 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 1662 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:54:37 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-3008158b-8799-44d0-88f4-e921b3b56871 req-8f3ee86e-de06-48de-82e3-dd21d2031692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "name": "network-vif-unplugged", "status": "completed", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:54:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3008158b-8799-44d0-88f4-e921b3b56871 req-8f3ee86e-de06-48de-82e3-dd21d2031692 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3008158b-8799-44d0-88f4-e921b3b56871 req-8f3ee86e-de06-48de-82e3-dd21d2031692 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:37 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-3008158b-8799-44d0-88f4-e921b3b56871 req-8f3ee86e-de06-48de-82e3-dd21d2031692 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-3008158b-8799-44d0-88f4-e921b3b56871 req-8f3ee86e-de06-48de-82e3-dd21d2031692 service nova] Creating event network-vif-unplugged:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:54:37 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-3008158b-8799-44d0-88f4-e921b3b56871 req-8f3ee86e-de06-48de-82e3-dd21d2031692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033661 Apr 12 03:54:37 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 328/982] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:54:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:38 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9dce0e55-0867-4052-a2d1-c5145640aeef req-c0bdf65c-8b44-4d1f-b990-6b390ccd4d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "name": "network-vif-deleted", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:54:38 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9dce0e55-0867-4052-a2d1-c5145640aeef req-c0bdf65c-8b44-4d1f-b990-6b390ccd4d9e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9dce0e55-0867-4052-a2d1-c5145640aeef req-c0bdf65c-8b44-4d1f-b990-6b390ccd4d9e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:38 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9dce0e55-0867-4052-a2d1-c5145640aeef req-c0bdf65c-8b44-4d1f-b990-6b390ccd4d9e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:38 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:54:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9dce0e55-0867-4052-a2d1-c5145640aeef req-c0bdf65c-8b44-4d1f-b990-6b390ccd4d9e service nova] Creating event network-vif-deleted:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:54:38 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9dce0e55-0867-4052-a2d1-c5145640aeef req-c0bdf65c-8b44-4d1f-b990-6b390ccd4d9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041991 Apr 12 03:54:38 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 328/983] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:54:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:54:39 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-10167fe7-c96d-428b-adb0-934029507ff6 req-037f1183-de42-4930-9ea4-eb92ee09844a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a705900-a0de-46e3-9af4-d07911f181c0", "name": "network-vif-plugged", "status": "completed", "tag": "55b4c29c-432e-4323-a5d6-fc62a42f8655"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:54:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-10167fe7-c96d-428b-adb0-934029507ff6 req-037f1183-de42-4930-9ea4-eb92ee09844a service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:54:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-10167fe7-c96d-428b-adb0-934029507ff6 req-037f1183-de42-4930-9ea4-eb92ee09844a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:54:39 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-10167fe7-c96d-428b-adb0-934029507ff6 req-037f1183-de42-4930-9ea4-eb92ee09844a service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:54:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-10167fe7-c96d-428b-adb0-934029507ff6 req-037f1183-de42-4930-9ea4-eb92ee09844a service nova] Creating event network-vif-plugged:55b4c29c-432e-4323-a5d6-fc62a42f8655 for instance 9a705900-a0de-46e3-9af4-d07911f181c0 on user Apr 12 03:54:39 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-10167fe7-c96d-428b-adb0-934029507ff6 req-037f1183-de42-4930-9ea4-eb92ee09844a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027642 Apr 12 03:54:39 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 328/984] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=12 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=28 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:00 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:55:00 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-3cb75d31-071b-46f2-aa01-6f67076b4d8c tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1434 microversion: 2.1 time: 0.156833 Apr 12 03:55:00 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 329/985] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:54:59 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1434 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:55:01 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1b9b9154-d440-4a4e-ad31-505ed60fa8aa req-aec2aeb0-6778-4964-9406-96f1494b7561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:55:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b9b9154-d440-4a4e-ad31-505ed60fa8aa req-aec2aeb0-6778-4964-9406-96f1494b7561 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b9b9154-d440-4a4e-ad31-505ed60fa8aa req-aec2aeb0-6778-4964-9406-96f1494b7561 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b9b9154-d440-4a4e-ad31-505ed60fa8aa req-aec2aeb0-6778-4964-9406-96f1494b7561 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b9b9154-d440-4a4e-ad31-505ed60fa8aa req-aec2aeb0-6778-4964-9406-96f1494b7561 service nova] Creating event network-changed:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:55:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1b9b9154-d440-4a4e-ad31-505ed60fa8aa req-aec2aeb0-6778-4964-9406-96f1494b7561 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035564 Apr 12 03:55:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 329/986] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:55:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=14 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:01 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lazy-loading 'flavor' on Instance uuid 1e4dae15-f69f-4e44-959a-7480e185020b {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:55:02 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-51c1e833-e109-49de-9fd1-e101a1d9e1ad tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b/action" status: 202 len: 0 microversion: 2.1 time: 0.208642 Apr 12 03:55:02 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 329/987] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:55:01 2023] POST /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:02 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:55:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f26958d4-c935-46ea-b55d-00c77b5a68aa tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1440 microversion: 2.1 time: 0.258515 Apr 12 03:55:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 330/988] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:02 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1440 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:55:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-unplugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}, {"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-plugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:55:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] Creating event network-vif-unplugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:55:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] Creating event network-vif-plugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:55:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-4aa270ca-aa5d-4113-8b36-5ee5e601073e req-18c1ab42-3add-49c5-ba3d-ed1b3b6379d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030668 Apr 12 03:55:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 330/989] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:55:03 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:55:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1499c205-2681-470d-a576-f14d45e6b3fb req-5b49bc36-9a8f-4df1-86fb-186b7025c3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:55:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1499c205-2681-470d-a576-f14d45e6b3fb req-5b49bc36-9a8f-4df1-86fb-186b7025c3e3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1499c205-2681-470d-a576-f14d45e6b3fb req-5b49bc36-9a8f-4df1-86fb-186b7025c3e3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1499c205-2681-470d-a576-f14d45e6b3fb req-5b49bc36-9a8f-4df1-86fb-186b7025c3e3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1499c205-2681-470d-a576-f14d45e6b3fb req-5b49bc36-9a8f-4df1-86fb-186b7025c3e3 service nova] Creating event network-changed:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:55:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1499c205-2681-470d-a576-f14d45e6b3fb req-5b49bc36-9a8f-4df1-86fb-186b7025c3e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045268 Apr 12 03:55:04 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 330/990] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:55:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:08 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:55:08 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-cdda4607-520a-4103-acb2-272041e7e9fe tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1546 microversion: 2.1 time: 0.382724 Apr 12 03:55:08 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 331/991] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:07 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1546 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:08 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-7d608da2-fac9-47cc-82df-8d3e1d85266c tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/action" status: 200 len: 28489 microversion: 2.1 time: 0.218073 Apr 12 03:55:08 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 331/992] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:55:08 2023] POST /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b/action => generated 28489 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:08 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:55:08 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-50645768-05dd-4cc7-98be-7954ff6e764f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13" status: 200 len: 1540 microversion: 2.1 time: 0.161588 Apr 12 03:55:08 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 331/993] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:08 2023] GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 => generated 1540 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=18 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] HTTP exception thrown: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Request method failure captured: Apr 12 03:55:27 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 HTTP/1.1 Apr 12 03:55:27 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:55:27 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:55:27 user devstack@n-api.service[62072]: Connection: close Apr 12 03:55:27 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:55:27 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:55:27 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:55:27 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:55:27 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiiHXD3bj-_gmY-MjT9lxk3uZSAt86iIoSEV8VJ-AZeoBSPFglxAqXpOki4DN0dF0yIUFZ9JdftG3L4UY7frKVv1ACxUzjwt_zJb18C9V1v47GN8Gn_wFLXOo4EVBwK-3cOgnBWNHKJ5kXooAE0O7vKi1TMgLnfRnsmmPdBSy_e0-Lg Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Project-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a341e582192a47548df8627d82c96ea8"}]}] Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Tenant-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:27 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:27 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:27 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:55:27 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:55:27 user devstack@n-api.service[62072]: X-User-Id: 872fbc3d59274cd480c17b4b7342499a Apr 12 03:55:27 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:27 user devstack@n-api.service[62072]: method: > Apr 12 03:55:27 user devstack@n-api.service[62072]: exception: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:27 user devstack@n-api.service[62072]: action_args: {'id': '9a705900-a0de-46e3-9af4-d07911f181c0'} Apr 12 03:55:27 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:27 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:27 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Returning 404 to user: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:55:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4ffcb0bd-73ff-4757-99c4-982c65ff16cc tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 404 len: 111 microversion: 2.1 time: 0.036685 Apr 12 03:55:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 332/994] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:27 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:55:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-e71dc9f9-852d-446f-9981-211786162b04 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '.version_select at 0x7f76a6ec64d0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:27 user devstack@n-api.service[62073]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e71dc9f9-852d-446f-9981-211786162b04 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [2f262f0f-8565-4ef7-b5be-83fb0d8461c8] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 03:55:27 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:27 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=9 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:28 user devstack@n-api.service[62073]: INFO oslo.messaging._drivers.impl_rabbit [None req-e71dc9f9-852d-446f-9981-211786162b04 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [2f262f0f-8565-4ef7-b5be-83fb0d8461c8] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47568. Apr 12 03:55:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-e71dc9f9-852d-446f-9981-211786162b04 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939295877" status: 202 len: 0 microversion: 2.1 time: 1.046906 Apr 12 03:55:28 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 332/995] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 03:55:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939295877 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] HTTP exception thrown: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Request method failure captured: Apr 12 03:55:33 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 HTTP/1.1 Apr 12 03:55:33 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:55:33 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:55:33 user devstack@n-api.service[62074]: Connection: close Apr 12 03:55:33 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:55:33 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:55:33 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:55:33 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:55:33 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiiHXD3bj-_gmY-MjT9lxk3uZSAt86iIoSEV8VJ-AZeoBSPFglxAqXpOki4DN0dF0yIUFZ9JdftG3L4UY7frKVv1ACxUzjwt_zJb18C9V1v47GN8Gn_wFLXOo4EVBwK-3cOgnBWNHKJ5kXooAE0O7vKi1TMgLnfRnsmmPdBSy_e0-Lg Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Project-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a341e582192a47548df8627d82c96ea8"}]}] Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Tenant-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:33 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:33 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:33 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:55:33 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:55:33 user devstack@n-api.service[62074]: X-User-Id: 872fbc3d59274cd480c17b4b7342499a Apr 12 03:55:33 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:33 user devstack@n-api.service[62074]: method: > Apr 12 03:55:33 user devstack@n-api.service[62074]: exception: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62074]: action_args: {'id': '9a705900-a0de-46e3-9af4-d07911f181c0'} Apr 12 03:55:33 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Returning 404 to user: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:55:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c0b1d393-29a4-410a-8aeb-c1573f614dc3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 404 len: 111 microversion: 2.1 time: 0.034950 Apr 12 03:55:33 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 332/996] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:55:33 2023] DELETE /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 9a705900-a0de-46e3-9af4-d07911f181c0] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] HTTP exception thrown: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Request method failure captured: Apr 12 03:55:33 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 HTTP/1.1 Apr 12 03:55:33 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:55:33 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:55:33 user devstack@n-api.service[62072]: Connection: close Apr 12 03:55:33 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:55:33 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:55:33 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:55:33 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:55:33 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiiHXD3bj-_gmY-MjT9lxk3uZSAt86iIoSEV8VJ-AZeoBSPFglxAqXpOki4DN0dF0yIUFZ9JdftG3L4UY7frKVv1ACxUzjwt_zJb18C9V1v47GN8Gn_wFLXOo4EVBwK-3cOgnBWNHKJ5kXooAE0O7vKi1TMgLnfRnsmmPdBSy_e0-Lg Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Project-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Project-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a341e582192a47548df8627d82c96ea8"}]}] Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Tenant: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Tenant-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:33 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:33 user devstack@n-api.service[62072]: X-User: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:33 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:55:33 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:55:33 user devstack@n-api.service[62072]: X-User-Id: 872fbc3d59274cd480c17b4b7342499a Apr 12 03:55:33 user devstack@n-api.service[62072]: X-User-Name: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:33 user devstack@n-api.service[62072]: method: > Apr 12 03:55:33 user devstack@n-api.service[62072]: exception: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62072]: action_args: {'id': '9a705900-a0de-46e3-9af4-d07911f181c0'} Apr 12 03:55:33 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. Apr 12 03:55:33 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:55:33 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Returning 404 to user: Instance 9a705900-a0de-46e3-9af4-d07911f181c0 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:55:33 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-88964e1c-5af9-4e8a-86db-dbd0bf402bd3 tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0" status: 404 len: 111 microversion: 2.1 time: 0.033725 Apr 12 03:55:33 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 333/997] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:33 2023] GET /compute/v2.1/servers/9a705900-a0de-46e3-9af4-d07911f181c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] HTTP exception thrown: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Request method failure captured: Apr 12 03:55:35 user devstack@n-api.service[62073]: request: DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 HTTP/1.1 Apr 12 03:55:35 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:55:35 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:55:35 user devstack@n-api.service[62073]: Connection: close Apr 12 03:55:35 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:55:35 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:55:35 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:55:35 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:55:35 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiiHXD3bj-_gmY-MjT9lxk3uZSAt86iIoSEV8VJ-AZeoBSPFglxAqXpOki4DN0dF0yIUFZ9JdftG3L4UY7frKVv1ACxUzjwt_zJb18C9V1v47GN8Gn_wFLXOo4EVBwK-3cOgnBWNHKJ5kXooAE0O7vKi1TMgLnfRnsmmPdBSy_e0-Lg Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Project-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Project-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a341e582192a47548df8627d82c96ea8"}]}] Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Tenant: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Tenant-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:35 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:35 user devstack@n-api.service[62073]: X-User: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:35 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:55:35 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:55:35 user devstack@n-api.service[62073]: X-User-Id: 872fbc3d59274cd480c17b4b7342499a Apr 12 03:55:35 user devstack@n-api.service[62073]: X-User-Name: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:35 user devstack@n-api.service[62073]: method: > Apr 12 03:55:35 user devstack@n-api.service[62073]: exception: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62073]: action_args: {'id': '606425bb-8968-41f9-b3a5-80b6fd188a67'} Apr 12 03:55:35 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Returning 404 to user: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:55:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-101e8dae-ad49-4433-b17b-c6297789de4b tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 404 len: 111 microversion: 2.1 time: 0.029308 Apr 12 03:55:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 333/998] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:55:35 2023] DELETE /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] [instance: 606425bb-8968-41f9-b3a5-80b6fd188a67] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] HTTP exception thrown: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Request method failure captured: Apr 12 03:55:35 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 HTTP/1.1 Apr 12 03:55:35 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:55:35 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:55:35 user devstack@n-api.service[62074]: Connection: close Apr 12 03:55:35 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:55:35 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:55:35 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:55:35 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:55:35 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiiHXD3bj-_gmY-MjT9lxk3uZSAt86iIoSEV8VJ-AZeoBSPFglxAqXpOki4DN0dF0yIUFZ9JdftG3L4UY7frKVv1ACxUzjwt_zJb18C9V1v47GN8Gn_wFLXOo4EVBwK-3cOgnBWNHKJ5kXooAE0O7vKi1TMgLnfRnsmmPdBSy_e0-Lg Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Project-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Project-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a341e582192a47548df8627d82c96ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a341e582192a47548df8627d82c96ea8"}]}] Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Tenant: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Tenant-Id: a341e582192a47548df8627d82c96ea8 Apr 12 03:55:35 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-617614045 Apr 12 03:55:35 user devstack@n-api.service[62074]: X-User: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:35 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:55:35 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:55:35 user devstack@n-api.service[62074]: X-User-Id: 872fbc3d59274cd480c17b4b7342499a Apr 12 03:55:35 user devstack@n-api.service[62074]: X-User-Name: tempest-AttachVolumeTestJSON-617614045-project-member Apr 12 03:55:35 user devstack@n-api.service[62074]: method: > Apr 12 03:55:35 user devstack@n-api.service[62074]: exception: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62074]: action_args: {'id': '606425bb-8968-41f9-b3a5-80b6fd188a67'} Apr 12 03:55:35 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. Apr 12 03:55:35 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:55:35 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] Returning 404 to user: Instance 606425bb-8968-41f9-b3a5-80b6fd188a67 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:55:35 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4c662085-8533-495a-b99f-827da9d6222d tempest-AttachVolumeTestJSON-617614045 tempest-AttachVolumeTestJSON-617614045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67" status: 404 len: 111 microversion: 2.1 time: 0.031009 Apr 12 03:55:35 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 333/999] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:35 2023] GET /compute/v2.1/servers/606425bb-8968-41f9-b3a5-80b6fd188a67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:55:52 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:55:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-fc02d84f-5987-487a-beac-ac30527ba59d tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1499 microversion: 2.1 time: 0.163175 Apr 12 03:55:52 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 334/1000] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:55:52 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:56:00 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:00 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:00 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-480847617", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "networks": [{"uuid": "123991b1-68ee-4b1b-8ce9-35b830ec5822"}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:00 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] validate_networks() for [('123991b1-68ee-4b1b-8ce9-35b830ec5822', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Getting quotas for project b4b1260a71aa436081e636ca7b996ead. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Getting quotas for user 79bd18d6965c4f85bbbc121864fe5782 and project b4b1260a71aa436081e636ca7b996ead. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:56:01 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:56:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-8a2499a4-67e1-4178-8d2a-cfa0979178ba tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.846470 Apr 12 03:56:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 334/1001] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:56:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:56:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-dfb82087-1c15-4215-80f1-bde07a78f390 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:01 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-dfb82087-1c15-4215-80f1-bde07a78f390 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:01 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:01 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:01 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-dfb82087-1c15-4215-80f1-bde07a78f390 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bd18d6965c4f85bbbc121864fe5782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b1260a71aa436081e636ca7b996ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:56:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-dfb82087-1c15-4215-80f1-bde07a78f390 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0" status: 200 len: 1207 microversion: 2.1 time: 0.135411 Apr 12 03:56:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 334/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:01 2023] GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0 => generated 1207 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:56:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:03 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-312b2dc4-ba44-4ef2-b85d-9a309a8626aa req-b1b9c507-8c81-4452-a1cd-b876f98ed978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa9190f-a85c-4107-9c7c-3de959b5d4d0", "tag": "8531b3ef-8643-4221-8728-14adc021e84f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-312b2dc4-ba44-4ef2-b85d-9a309a8626aa req-b1b9c507-8c81-4452-a1cd-b876f98ed978 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-312b2dc4-ba44-4ef2-b85d-9a309a8626aa req-b1b9c507-8c81-4452-a1cd-b876f98ed978 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-312b2dc4-ba44-4ef2-b85d-9a309a8626aa req-b1b9c507-8c81-4452-a1cd-b876f98ed978 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-312b2dc4-ba44-4ef2-b85d-9a309a8626aa req-b1b9c507-8c81-4452-a1cd-b876f98ed978 service nova] Creating event network-changed:8531b3ef-8643-4221-8728-14adc021e84f for instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 on user Apr 12 03:56:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-312b2dc4-ba44-4ef2-b85d-9a309a8626aa req-b1b9c507-8c81-4452-a1cd-b876f98ed978 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116074 Apr 12 03:56:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 335/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:05 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-ded99285-1722-481a-bc2a-3c39a5f87626 req-73fdeedf-0d44-4400-ada2-e76a4e7a103f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa9190f-a85c-4107-9c7c-3de959b5d4d0", "name": "network-vif-plugged", "status": "completed", "tag": "8531b3ef-8643-4221-8728-14adc021e84f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ded99285-1722-481a-bc2a-3c39a5f87626 req-73fdeedf-0d44-4400-ada2-e76a4e7a103f service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ded99285-1722-481a-bc2a-3c39a5f87626 req-73fdeedf-0d44-4400-ada2-e76a4e7a103f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ded99285-1722-481a-bc2a-3c39a5f87626 req-73fdeedf-0d44-4400-ada2-e76a4e7a103f service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ded99285-1722-481a-bc2a-3c39a5f87626 req-73fdeedf-0d44-4400-ada2-e76a4e7a103f service nova] Creating event network-vif-plugged:8531b3ef-8643-4221-8728-14adc021e84f for instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 on user Apr 12 03:56:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-ded99285-1722-481a-bc2a-3c39a5f87626 req-73fdeedf-0d44-4400-ada2-e76a4e7a103f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079203 Apr 12 03:56:05 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 335/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-1a03e474-99e7-4e80-8a06-d557c6458411 req-f461db22-f0e9-46e9-94eb-6fe685abe31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa9190f-a85c-4107-9c7c-3de959b5d4d0", "name": "network-vif-plugged", "status": "completed", "tag": "8531b3ef-8643-4221-8728-14adc021e84f"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a03e474-99e7-4e80-8a06-d557c6458411 req-f461db22-f0e9-46e9-94eb-6fe685abe31e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a03e474-99e7-4e80-8a06-d557c6458411 req-f461db22-f0e9-46e9-94eb-6fe685abe31e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-1a03e474-99e7-4e80-8a06-d557c6458411 req-f461db22-f0e9-46e9-94eb-6fe685abe31e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-1a03e474-99e7-4e80-8a06-d557c6458411 req-f461db22-f0e9-46e9-94eb-6fe685abe31e service nova] Creating event network-vif-plugged:8531b3ef-8643-4221-8728-14adc021e84f for instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 on user Apr 12 03:56:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-1a03e474-99e7-4e80-8a06-d557c6458411 req-f461db22-f0e9-46e9-94eb-6fe685abe31e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032294 Apr 12 03:56:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 335/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:08 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Going to try to terminate instance {{(pid=62072) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:56:08 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-edcbf72c-6cec-4922-9011-50d47b454a77 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 204 len: 0 microversion: 2.1 time: 0.112429 Apr 12 03:56:08 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 336/1006] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:56:08 2023] DELETE /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:08 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:56:08 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-218fe20b-35b9-4f61-ba58-046154f58717 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 200 len: 1552 microversion: 2.1 time: 0.184542 Apr 12 03:56:08 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 336/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:08 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:56:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-14336358-3f26-44b7-a0e0-c9922cf6f8f3 req-827b1ccd-a4c1-472a-9be3-fe3531deab45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-14336358-3f26-44b7-a0e0-c9922cf6f8f3 req-827b1ccd-a4c1-472a-9be3-fe3531deab45 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-14336358-3f26-44b7-a0e0-c9922cf6f8f3 req-827b1ccd-a4c1-472a-9be3-fe3531deab45 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-14336358-3f26-44b7-a0e0-c9922cf6f8f3 req-827b1ccd-a4c1-472a-9be3-fe3531deab45 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-14336358-3f26-44b7-a0e0-c9922cf6f8f3 req-827b1ccd-a4c1-472a-9be3-fe3531deab45 service nova] Creating event network-vif-unplugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:56:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-14336358-3f26-44b7-a0e0-c9922cf6f8f3 req-827b1ccd-a4c1-472a-9be3-fe3531deab45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040520 Apr 12 03:56:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 336/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:10 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-aee2569e-7137-494e-8493-17fa48e0704e req-5f4972bc-6239-4f8e-bc15-dc20b0071a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-deleted", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-aee2569e-7137-494e-8493-17fa48e0704e req-5f4972bc-6239-4f8e-bc15-dc20b0071a88 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-aee2569e-7137-494e-8493-17fa48e0704e req-5f4972bc-6239-4f8e-bc15-dc20b0071a88 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:10 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-aee2569e-7137-494e-8493-17fa48e0704e req-5f4972bc-6239-4f8e-bc15-dc20b0071a88 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-aee2569e-7137-494e-8493-17fa48e0704e req-5f4972bc-6239-4f8e-bc15-dc20b0071a88 service nova] Creating event network-vif-deleted:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:56:10 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-aee2569e-7137-494e-8493-17fa48e0704e req-5f4972bc-6239-4f8e-bc15-dc20b0071a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030118 Apr 12 03:56:10 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 337/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-18847deb-7959-4062-b846-409274f28f93 req-42d4ea94-27d7-41b5-af3a-d0b1640b6b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba7373-1427-409d-9aa7-6cb7894d665b", "name": "network-vif-plugged", "status": "completed", "tag": "d7e82a6e-18fe-44f2-b866-f0561d1b8209"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-18847deb-7959-4062-b846-409274f28f93 req-42d4ea94-27d7-41b5-af3a-d0b1640b6b31 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-18847deb-7959-4062-b846-409274f28f93 req-42d4ea94-27d7-41b5-af3a-d0b1640b6b31 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-18847deb-7959-4062-b846-409274f28f93 req-42d4ea94-27d7-41b5-af3a-d0b1640b6b31 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-18847deb-7959-4062-b846-409274f28f93 req-42d4ea94-27d7-41b5-af3a-d0b1640b6b31 service nova] Creating event network-vif-plugged:d7e82a6e-18fe-44f2-b866-f0561d1b8209 for instance 65ba7373-1427-409d-9aa7-6cb7894d665b on user Apr 12 03:56:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-18847deb-7959-4062-b846-409274f28f93 req-42d4ea94-27d7-41b5-af3a-d0b1640b6b31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Apr 12 03:56:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 337/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:51 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bd18d6965c4f85bbbc121864fe5782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b1260a71aa436081e636ca7b996ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:56:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-e87c112c-2896-467e-a28f-2b4970e7c6d2 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0" status: 200 len: 1485 microversion: 2.1 time: 0.233728 Apr 12 03:56:51 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 337/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:51 2023] GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0 => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:52 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62072) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 03:56:52 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-a7af2195-8e4b-4dfd-a3fa-646955cad4c7 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b/action" status: 202 len: 0 microversion: 2.1 time: 0.121507 Apr 12 03:56:52 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 338/1012] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:56:52 2023] POST /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:52 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:56:52 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-9b618259-c646-4acd-baef-a967dbf78572 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1507 microversion: 2.1 time: 0.195711 Apr 12 03:56:52 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 338/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:52 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:56:59 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b HTTP/1.1 Apr 12 03:56:59 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:56:59 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:56:59 user devstack@n-api.service[62074]: Connection: close Apr 12 03:56:59 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:56:59 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:56:59 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:56:59 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:56:59 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:56:59 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62074]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:56:59 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:56:59 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:56:59 user devstack@n-api.service[62074]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:56:59 user devstack@n-api.service[62074]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:56:59 user devstack@n-api.service[62074]: method: > Apr 12 03:56:59 user devstack@n-api.service[62074]: exception: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62074]: action_args: {'id': '65ba7373-1427-409d-9aa7-6cb7894d665b'} Apr 12 03:56:59 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:56:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-19483ab9-ab38-4fd3-98e8-c25c79abc42f tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 404 len: 111 microversion: 2.1 time: 0.030810 Apr 12 03:56:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 338/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:59 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:56:59 user devstack@n-api.service[62072]: request: DELETE /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b HTTP/1.1 Apr 12 03:56:59 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:56:59 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:56:59 user devstack@n-api.service[62072]: Connection: close Apr 12 03:56:59 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:56:59 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:56:59 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:56:59 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:56:59 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:56:59 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62072]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:56:59 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:56:59 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:56:59 user devstack@n-api.service[62072]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:56:59 user devstack@n-api.service[62072]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:56:59 user devstack@n-api.service[62072]: method: > Apr 12 03:56:59 user devstack@n-api.service[62072]: exception: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62072]: action_args: {'id': '65ba7373-1427-409d-9aa7-6cb7894d665b'} Apr 12 03:56:59 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:56:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-380ab27d-bd3a-43a0-9022-34b25295af38 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 404 len: 111 microversion: 2.1 time: 0.027903 Apr 12 03:56:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 339/1015] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:56:59 2023] DELETE /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 65ba7373-1427-409d-9aa7-6cb7894d665b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:56:59 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b HTTP/1.1 Apr 12 03:56:59 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:56:59 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:56:59 user devstack@n-api.service[62073]: Connection: close Apr 12 03:56:59 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:56:59 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:56:59 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:56:59 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:56:59 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:56:59 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:56:59 user devstack@n-api.service[62073]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:56:59 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:56:59 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:56:59 user devstack@n-api.service[62073]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:56:59 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:56:59 user devstack@n-api.service[62073]: method: > Apr 12 03:56:59 user devstack@n-api.service[62073]: exception: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62073]: action_args: {'id': '65ba7373-1427-409d-9aa7-6cb7894d665b'} Apr 12 03:56:59 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. Apr 12 03:56:59 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 65ba7373-1427-409d-9aa7-6cb7894d665b could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:56:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-be6ddd0f-fc45-436e-ad32-a9b1367b9339 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b" status: 404 len: 111 microversion: 2.1 time: 0.027544 Apr 12 03:56:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 339/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:59 2023] GET /compute/v2.1/servers/65ba7373-1427-409d-9aa7-6cb7894d665b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-e3aac771-43df-431e-9a6d-77b3e718794a req-5b75bdfb-f198-489f-91bd-cb3e298f7db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:59 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e3aac771-43df-431e-9a6d-77b3e718794a req-5b75bdfb-f198-489f-91bd-cb3e298f7db0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e3aac771-43df-431e-9a6d-77b3e718794a req-5b75bdfb-f198-489f-91bd-cb3e298f7db0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-e3aac771-43df-431e-9a6d-77b3e718794a req-5b75bdfb-f198-489f-91bd-cb3e298f7db0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-e3aac771-43df-431e-9a6d-77b3e718794a req-5b75bdfb-f198-489f-91bd-cb3e298f7db0 service nova] Creating event network-changed:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:56:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-e3aac771-43df-431e-9a6d-77b3e718794a req-5b75bdfb-f198-489f-91bd-cb3e298f7db0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028634 Apr 12 03:56:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 340/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-7ea64428-ef2b-458e-91e6-05fec33cdba3 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13" status: 204 len: 0 microversion: 2.1 time: 0.119984 Apr 12 03:56:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 339/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:56:59 2023] DELETE /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f422f1a05a4a92ba387e424850b360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815b65aa5ad9442db0a087c646f96bbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:56:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-69fe180e-a53f-429c-90f5-2e9b5de654a8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13" status: 200 len: 1546 microversion: 2.1 time: 0.230726 Apr 12 03:56:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 340/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:56:59 2023] GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 => generated 1546 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-9d892056-6b7a-426b-8683-9469e4a6b453 req-a7f3042b-aa7d-4166-8f9c-2839e07c1fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "name": "network-vif-unplugged", "status": "completed", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9d892056-6b7a-426b-8683-9469e4a6b453 req-a7f3042b-aa7d-4166-8f9c-2839e07c1fba service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9d892056-6b7a-426b-8683-9469e4a6b453 req-a7f3042b-aa7d-4166-8f9c-2839e07c1fba service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:56:59 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-9d892056-6b7a-426b-8683-9469e4a6b453 req-a7f3042b-aa7d-4166-8f9c-2839e07c1fba service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:56:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-9d892056-6b7a-426b-8683-9469e4a6b453 req-a7f3042b-aa7d-4166-8f9c-2839e07c1fba service nova] Creating event network-vif-unplugged:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:56:59 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-9d892056-6b7a-426b-8683-9469e4a6b453 req-a7f3042b-aa7d-4166-8f9c-2839e07c1fba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054666 Apr 12 03:56:59 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 341/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:01 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-414bc14d-ccb3-4dbc-8628-1e5376c1b133 req-34e4b480-ed2a-49c0-8ae4-dda530ac8631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "name": "network-vif-deleted", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-414bc14d-ccb3-4dbc-8628-1e5376c1b133 req-34e4b480-ed2a-49c0-8ae4-dda530ac8631 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-414bc14d-ccb3-4dbc-8628-1e5376c1b133 req-34e4b480-ed2a-49c0-8ae4-dda530ac8631 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:01 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-414bc14d-ccb3-4dbc-8628-1e5376c1b133 req-34e4b480-ed2a-49c0-8ae4-dda530ac8631 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-414bc14d-ccb3-4dbc-8628-1e5376c1b133 req-34e4b480-ed2a-49c0-8ae4-dda530ac8631 service nova] Creating event network-vif-deleted:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:57:01 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-414bc14d-ccb3-4dbc-8628-1e5376c1b133 req-34e4b480-ed2a-49c0-8ae4-dda530ac8631 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030816 Apr 12 03:57:01 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 340/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:01 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-58e11c15-275f-45e5-a3c4-4738291ef383 req-5b830383-aa0a-46bc-bb71-630d21e8be24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d533f5f-dbed-4878-a9b1-2ce4fae8fa13", "name": "network-vif-plugged", "status": "completed", "tag": "2ef93926-6cf3-4d57-be98-ab555ac58b4c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-58e11c15-275f-45e5-a3c4-4738291ef383 req-5b830383-aa0a-46bc-bb71-630d21e8be24 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-58e11c15-275f-45e5-a3c4-4738291ef383 req-5b830383-aa0a-46bc-bb71-630d21e8be24 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:01 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-58e11c15-275f-45e5-a3c4-4738291ef383 req-5b830383-aa0a-46bc-bb71-630d21e8be24 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-58e11c15-275f-45e5-a3c4-4738291ef383 req-5b830383-aa0a-46bc-bb71-630d21e8be24 service nova] Creating event network-vif-plugged:2ef93926-6cf3-4d57-be98-ab555ac58b4c for instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 on user Apr 12 03:57:01 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-58e11c15-275f-45e5-a3c4-4738291ef383 req-5b830383-aa0a-46bc-bb71-630d21e8be24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029165 Apr 12 03:57:01 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 341/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:02 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-01d595d5-bba7-4af6-95e9-314eabbe3cd9 req-a9e4524a-5fd4-47a1-be81-6fd70fcfcaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-plugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-01d595d5-bba7-4af6-95e9-314eabbe3cd9 req-a9e4524a-5fd4-47a1-be81-6fd70fcfcaa0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-01d595d5-bba7-4af6-95e9-314eabbe3cd9 req-a9e4524a-5fd4-47a1-be81-6fd70fcfcaa0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:02 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-01d595d5-bba7-4af6-95e9-314eabbe3cd9 req-a9e4524a-5fd4-47a1-be81-6fd70fcfcaa0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-01d595d5-bba7-4af6-95e9-314eabbe3cd9 req-a9e4524a-5fd4-47a1-be81-6fd70fcfcaa0 service nova] Creating event network-vif-plugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:57:02 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-01d595d5-bba7-4af6-95e9-314eabbe3cd9 req-a9e4524a-5fd4-47a1-be81-6fd70fcfcaa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039712 Apr 12 03:57:02 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 342/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:04 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-a866a60c-5de8-49f6-96f7-14ab439787de req-09a17ed2-87f4-4399-bd79-75b0cf3ef5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-plugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a866a60c-5de8-49f6-96f7-14ab439787de req-09a17ed2-87f4-4399-bd79-75b0cf3ef5c6 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a866a60c-5de8-49f6-96f7-14ab439787de req-09a17ed2-87f4-4399-bd79-75b0cf3ef5c6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:04 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-a866a60c-5de8-49f6-96f7-14ab439787de req-09a17ed2-87f4-4399-bd79-75b0cf3ef5c6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-a866a60c-5de8-49f6-96f7-14ab439787de req-09a17ed2-87f4-4399-bd79-75b0cf3ef5c6 service nova] Creating event network-vif-plugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:57:04 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-a866a60c-5de8-49f6-96f7-14ab439787de req-09a17ed2-87f4-4399-bd79-75b0cf3ef5c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031098 Apr 12 03:57:04 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 341/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=8 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=16 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:42 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:43 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:57:43 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-3cf7ba60-070a-4d1b-a390-a138a7d6c3f8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1552 microversion: 2.1 time: 0.155331 Apr 12 03:57:43 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 342/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:57:42 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 could not be found. Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:57:49 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 HTTP/1.1 Apr 12 03:57:49 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:57:49 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:57:49 user devstack@n-api.service[62072]: Connection: close Apr 12 03:57:49 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:57:49 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:57:49 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:57:49 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:57:49 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:57:49 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:49 user devstack@n-api.service[62072]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:57:49 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:57:49 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:57:49 user devstack@n-api.service[62072]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:57:49 user devstack@n-api.service[62072]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:57:49 user devstack@n-api.service[62072]: method: > Apr 12 03:57:49 user devstack@n-api.service[62072]: exception: Instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 could not be found. Apr 12 03:57:49 user devstack@n-api.service[62072]: action_args: {'id': '8d533f5f-dbed-4878-a9b1-2ce4fae8fa13'} Apr 12 03:57:49 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 could not be found. Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 could not be found. Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 could not be found. Apr 12 03:57:49 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:57:49 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:57:49 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-c5816703-eb9b-4b20-ba3d-e35745affbe8 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13" status: 404 len: 111 microversion: 2.1 time: 0.036820 Apr 12 03:57:49 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 343/1026] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:57:49 2023] GET /compute/v2.1/servers/8d533f5f-dbed-4878-a9b1-2ce4fae8fa13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:57:53 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 03:57:53 user devstack@n-api.service[62074]: Wed Apr 12 03:57:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd (ip 10.0.0.210) !!! Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:57:54 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd HTTP/1.1 Apr 12 03:57:54 user devstack@n-api.service[62074]: Accept: application/json Apr 12 03:57:54 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 03:57:54 user devstack@n-api.service[62074]: Connection: close Apr 12 03:57:54 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 03:57:54 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 03:57:54 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 03:57:54 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 03:57:54 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:57:54 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:54 user devstack@n-api.service[62074]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:57:54 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 03:57:54 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 03:57:54 user devstack@n-api.service[62074]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:57:54 user devstack@n-api.service[62074]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:57:54 user devstack@n-api.service[62074]: method: > Apr 12 03:57:54 user devstack@n-api.service[62074]: exception: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62074]: action_args: {'id': '48977eb2-ce43-4577-a1cb-340e35703dbd'} Apr 12 03:57:54 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:57:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-b10967d8-855e-4b9a-9ec6-d0efe8d4b975 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 404 len: 111 microversion: 2.1 time: 0.054732 Apr 12 03:57:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 342/1027] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:57:53 2023] DELETE /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] [instance: 48977eb2-ce43-4577-a1cb-340e35703dbd] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] HTTP exception thrown: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Request method failure captured: Apr 12 03:57:54 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd HTTP/1.1 Apr 12 03:57:54 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:57:54 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:57:54 user devstack@n-api.service[62073]: Connection: close Apr 12 03:57:54 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:57:54 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:57:54 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:57:54 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:57:54 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNiZ8R20neowsxXzDGZVq3Knl4gNeuUGPetW2C4vLCZaflWmolWnl785-k-TMg-2tkg8cVKla8624PkL-SpbxRI48pKLGABzT7h3_Q-V-wpb1JtJzo_XKku20yDSPnYEFczkCOzZ5l4sQhKGvEvLkHtYbcqWGl3sBqzgDaJKN4JYKl-Y Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Project-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/815b65aa5ad9442db0a087c646f96bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/815b65aa5ad9442db0a087c646f96bbd"}]}] Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Tenant-Id: 815b65aa5ad9442db0a087c646f96bbd Apr 12 03:57:54 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerActionsTestJSON-1898059859 Apr 12 03:57:54 user devstack@n-api.service[62073]: X-User: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:57:54 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:57:54 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:57:54 user devstack@n-api.service[62073]: X-User-Id: a7f422f1a05a4a92ba387e424850b360 Apr 12 03:57:54 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerActionsTestJSON-1898059859-project-member Apr 12 03:57:54 user devstack@n-api.service[62073]: method: > Apr 12 03:57:54 user devstack@n-api.service[62073]: exception: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62073]: action_args: {'id': '48977eb2-ce43-4577-a1cb-340e35703dbd'} Apr 12 03:57:54 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. Apr 12 03:57:54 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:57:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Returning 404 to user: Instance 48977eb2-ce43-4577-a1cb-340e35703dbd could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:57:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6cd941d3-5b8a-4310-93e1-540f8acd96a0 tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd" status: 404 len: 111 microversion: 2.1 time: 0.044376 Apr 12 03:57:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 343/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:57:54 2023] GET /compute/v2.1/servers/48977eb2-ce43-4577-a1cb-340e35703dbd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:57:54 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7261c5c5-b05e-4d39-bbfb-1f5c3835b16b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] Calling method '.version_select at 0x7f76a6730280>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:54 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7261c5c5-b05e-4d39-bbfb-1f5c3835b16b tempest-ServerActionsTestJSON-1898059859 tempest-ServerActionsTestJSON-1898059859-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-364276420" status: 202 len: 0 microversion: 2.1 time: 0.024517 Apr 12 03:57:54 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 344/1029] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 03:57:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-364276420 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:57:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-c4af9ac2-ed58-4a3e-b530-0270fd21cd42 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0" status: 204 len: 0 microversion: 2.1 time: 0.137907 Apr 12 03:57:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 343/1030] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:57:56 2023] DELETE /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:56 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-0d32de62-0eb8-48b9-af35-cfd59b3b6c87 req-1661a055-1a6b-40c3-bb81-a4121d44624d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa9190f-a85c-4107-9c7c-3de959b5d4d0", "name": "network-vif-unplugged", "status": "completed", "tag": "8531b3ef-8643-4221-8728-14adc021e84f"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:57 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bd18d6965c4f85bbbc121864fe5782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b1260a71aa436081e636ca7b996ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:57:57 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ddf0646d-09d3-4432-af13-e1f9ef66f292 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0" status: 200 len: 1491 microversion: 2.1 time: 0.252889 Apr 12 03:57:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0d32de62-0eb8-48b9-af35-cfd59b3b6c87 req-1661a055-1a6b-40c3-bb81-a4121d44624d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:57 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 344/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:57:56 2023] GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0 => generated 1491 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:57:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0d32de62-0eb8-48b9-af35-cfd59b3b6c87 req-1661a055-1a6b-40c3-bb81-a4121d44624d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0d32de62-0eb8-48b9-af35-cfd59b3b6c87 req-1661a055-1a6b-40c3-bb81-a4121d44624d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-0d32de62-0eb8-48b9-af35-cfd59b3b6c87 req-1661a055-1a6b-40c3-bb81-a4121d44624d service nova] Creating event network-vif-unplugged:8531b3ef-8643-4221-8728-14adc021e84f for instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 on user Apr 12 03:57:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-0d32de62-0eb8-48b9-af35-cfd59b3b6c87 req-1661a055-1a6b-40c3-bb81-a4121d44624d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035036 Apr 12 03:57:57 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 345/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:58 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-7670b7ee-a1bf-4302-aacf-8de063b6203a req-5e2143cc-87e3-42be-9fc0-fb349e6e3a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa9190f-a85c-4107-9c7c-3de959b5d4d0", "name": "network-vif-deleted", "tag": "8531b3ef-8643-4221-8728-14adc021e84f"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7670b7ee-a1bf-4302-aacf-8de063b6203a req-5e2143cc-87e3-42be-9fc0-fb349e6e3a80 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7670b7ee-a1bf-4302-aacf-8de063b6203a req-5e2143cc-87e3-42be-9fc0-fb349e6e3a80 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:58 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7670b7ee-a1bf-4302-aacf-8de063b6203a req-5e2143cc-87e3-42be-9fc0-fb349e6e3a80 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-7670b7ee-a1bf-4302-aacf-8de063b6203a req-5e2143cc-87e3-42be-9fc0-fb349e6e3a80 service nova] Creating event network-vif-deleted:8531b3ef-8643-4221-8728-14adc021e84f for instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 on user Apr 12 03:57:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-7670b7ee-a1bf-4302-aacf-8de063b6203a req-5e2143cc-87e3-42be-9fc0-fb349e6e3a80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035949 Apr 12 03:57:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 344/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:57:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-35ed6276-0e46-4651-97bb-b83ed88121f8 req-affc12f2-e54c-4bab-8053-58be5099a5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa9190f-a85c-4107-9c7c-3de959b5d4d0", "name": "network-vif-plugged", "status": "completed", "tag": "8531b3ef-8643-4221-8728-14adc021e84f"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:57:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-35ed6276-0e46-4651-97bb-b83ed88121f8 req-affc12f2-e54c-4bab-8053-58be5099a5ce service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:57:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-35ed6276-0e46-4651-97bb-b83ed88121f8 req-affc12f2-e54c-4bab-8053-58be5099a5ce service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:57:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-35ed6276-0e46-4651-97bb-b83ed88121f8 req-affc12f2-e54c-4bab-8053-58be5099a5ce service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:57:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-35ed6276-0e46-4651-97bb-b83ed88121f8 req-affc12f2-e54c-4bab-8053-58be5099a5ce service nova] Creating event network-vif-plugged:8531b3ef-8643-4221-8728-14adc021e84f for instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 on user Apr 12 03:57:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-35ed6276-0e46-4651-97bb-b83ed88121f8 req-affc12f2-e54c-4bab-8053-58be5099a5ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Apr 12 03:57:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 345/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:57:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1232389953", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] validate_networks() for [('311bda05-075c-4bb3-9469-b5117dd33353', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for user 44a0206f1323440db4f8411a3c3c088d and project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:58:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:58:06 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7a26269b-185f-4336-b8b2-198bdcd1815f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.746971 Apr 12 03:58:06 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 346/1035] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:58:06 2023] POST /compute/v2.1/servers => generated 381 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:58:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-9a57e18b-ed54-48b3-83cf-c152a65352b8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:58:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-9a57e18b-ed54-48b3-83cf-c152a65352b8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:58:06 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-9a57e18b-ed54-48b3-83cf-c152a65352b8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:58:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-9a57e18b-ed54-48b3-83cf-c152a65352b8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1216 microversion: 2.1 time: 0.107547 Apr 12 03:58:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 345/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:58:06 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-965303931", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] validate_networks() for [('311bda05-075c-4bb3-9469-b5117dd33353', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for user 44a0206f1323440db4f8411a3c3c088d and project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:58:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:58:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4512c8b6-16fa-4ba7-9380-d4e5b2049fcf tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.553324 Apr 12 03:58:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 346/1037] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:58:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:58:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-049178ed-0621-4142-82bc-3663a9b2e714 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:58:07 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-049178ed-0621-4142-82bc-3663a9b2e714 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:58:07 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-049178ed-0621-4142-82bc-3663a9b2e714 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:58:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-049178ed-0621-4142-82bc-3663a9b2e714 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 200 len: 1215 microversion: 2.1 time: 0.068976 Apr 12 03:58:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 347/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:58:07 2023] GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:58:09 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-52c99640-e322-4e9d-8eb9-e7b35aaa27f7 req-d195a0d6-2001-4b28-be30-1e43aa445963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:09 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-52c99640-e322-4e9d-8eb9-e7b35aaa27f7 req-d195a0d6-2001-4b28-be30-1e43aa445963 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-52c99640-e322-4e9d-8eb9-e7b35aaa27f7 req-d195a0d6-2001-4b28-be30-1e43aa445963 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:09 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-52c99640-e322-4e9d-8eb9-e7b35aaa27f7 req-d195a0d6-2001-4b28-be30-1e43aa445963 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-52c99640-e322-4e9d-8eb9-e7b35aaa27f7 req-d195a0d6-2001-4b28-be30-1e43aa445963 service nova] Creating event network-changed:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 03:58:09 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-52c99640-e322-4e9d-8eb9-e7b35aaa27f7 req-d195a0d6-2001-4b28-be30-1e43aa445963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039563 Apr 12 03:58:09 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 346/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1f4707e7-0b29-450d-bd3a-18eb5c6e59f6 req-fbacfbd0-0b06-40eb-b50a-20b5ed2a246c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1f4707e7-0b29-450d-bd3a-18eb5c6e59f6 req-fbacfbd0-0b06-40eb-b50a-20b5ed2a246c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1f4707e7-0b29-450d-bd3a-18eb5c6e59f6 req-fbacfbd0-0b06-40eb-b50a-20b5ed2a246c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1f4707e7-0b29-450d-bd3a-18eb5c6e59f6 req-fbacfbd0-0b06-40eb-b50a-20b5ed2a246c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1f4707e7-0b29-450d-bd3a-18eb5c6e59f6 req-fbacfbd0-0b06-40eb-b50a-20b5ed2a246c service nova] Creating event network-changed:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 03:58:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1f4707e7-0b29-450d-bd3a-18eb5c6e59f6 req-fbacfbd0-0b06-40eb-b50a-20b5ed2a246c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032313 Apr 12 03:58:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 347/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:11 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-0a3f9247-1ca8-45a9-8c61-78198d88886f req-0d0075f0-c3dd-40cf-94c6-db308436811e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0a3f9247-1ca8-45a9-8c61-78198d88886f req-0d0075f0-c3dd-40cf-94c6-db308436811e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0a3f9247-1ca8-45a9-8c61-78198d88886f req-0d0075f0-c3dd-40cf-94c6-db308436811e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:11 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-0a3f9247-1ca8-45a9-8c61-78198d88886f req-0d0075f0-c3dd-40cf-94c6-db308436811e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-0a3f9247-1ca8-45a9-8c61-78198d88886f req-0d0075f0-c3dd-40cf-94c6-db308436811e service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 03:58:11 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-0a3f9247-1ca8-45a9-8c61-78198d88886f req-0d0075f0-c3dd-40cf-94c6-db308436811e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034560 Apr 12 03:58:11 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 348/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:13 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-bef7bfe9-60c7-4ae4-9fb0-59a789349faf req-8d3f93ed-bc1a-46b7-97ed-c755045cf332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-plugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bef7bfe9-60c7-4ae4-9fb0-59a789349faf req-8d3f93ed-bc1a-46b7-97ed-c755045cf332 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bef7bfe9-60c7-4ae4-9fb0-59a789349faf req-8d3f93ed-bc1a-46b7-97ed-c755045cf332 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:13 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-bef7bfe9-60c7-4ae4-9fb0-59a789349faf req-8d3f93ed-bc1a-46b7-97ed-c755045cf332 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-bef7bfe9-60c7-4ae4-9fb0-59a789349faf req-8d3f93ed-bc1a-46b7-97ed-c755045cf332 service nova] Creating event network-vif-plugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 03:58:13 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-bef7bfe9-60c7-4ae4-9fb0-59a789349faf req-8d3f93ed-bc1a-46b7-97ed-c755045cf332 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090219 Apr 12 03:58:13 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 347/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:13 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-20fcce6c-feb4-4a42-b818-56dbf4ce9943 req-86fc04c3-13b8-4c3b-aacc-f52e888a7b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-20fcce6c-feb4-4a42-b818-56dbf4ce9943 req-86fc04c3-13b8-4c3b-aacc-f52e888a7b8b service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-20fcce6c-feb4-4a42-b818-56dbf4ce9943 req-86fc04c3-13b8-4c3b-aacc-f52e888a7b8b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:13 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-20fcce6c-feb4-4a42-b818-56dbf4ce9943 req-86fc04c3-13b8-4c3b-aacc-f52e888a7b8b service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-20fcce6c-feb4-4a42-b818-56dbf4ce9943 req-86fc04c3-13b8-4c3b-aacc-f52e888a7b8b service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 03:58:13 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-20fcce6c-feb4-4a42-b818-56dbf4ce9943 req-86fc04c3-13b8-4c3b-aacc-f52e888a7b8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027850 Apr 12 03:58:13 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 348/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:15 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c9d1a834-2276-4d6a-97c0-dd92edb0a3b4 req-cba05c46-dcb9-4fb2-8275-64178dd7ef39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-plugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c9d1a834-2276-4d6a-97c0-dd92edb0a3b4 req-cba05c46-dcb9-4fb2-8275-64178dd7ef39 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c9d1a834-2276-4d6a-97c0-dd92edb0a3b4 req-cba05c46-dcb9-4fb2-8275-64178dd7ef39 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:15 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c9d1a834-2276-4d6a-97c0-dd92edb0a3b4 req-cba05c46-dcb9-4fb2-8275-64178dd7ef39 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c9d1a834-2276-4d6a-97c0-dd92edb0a3b4 req-cba05c46-dcb9-4fb2-8275-64178dd7ef39 service nova] Creating event network-vif-plugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 03:58:15 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c9d1a834-2276-4d6a-97c0-dd92edb0a3b4 req-cba05c46-dcb9-4fb2-8275-64178dd7ef39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Apr 12 03:58:15 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 349/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=16 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f9d45aea-c10c-484e-8d59-fad8c909e687 req-875f8379-1e69-4b69-af94-8008844daf70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f9d45aea-c10c-484e-8d59-fad8c909e687 req-875f8379-1e69-4b69-af94-8008844daf70 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f9d45aea-c10c-484e-8d59-fad8c909e687 req-875f8379-1e69-4b69-af94-8008844daf70 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f9d45aea-c10c-484e-8d59-fad8c909e687 req-875f8379-1e69-4b69-af94-8008844daf70 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f9d45aea-c10c-484e-8d59-fad8c909e687 req-875f8379-1e69-4b69-af94-8008844daf70 service nova] Creating event network-changed:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:58:44 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Going to try to terminate instance {{(pid=62074) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 03:58:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f9d45aea-c10c-484e-8d59-fad8c909e687 req-875f8379-1e69-4b69-af94-8008844daf70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041146 Apr 12 03:58:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 349/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4bae6da8-fb96-4193-9840-75b66585cacb tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 204 len: 0 microversion: 2.1 time: 0.179076 Apr 12 03:58:44 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 348/1046] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 03:58:44 2023] DELETE /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=10 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:44 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447437f9d71b4f8ab0da168f0fca732f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ec2318ea05403db924630461ea77e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:58:44 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-b0f8f91d-fc89-4fb4-a9f3-366c4d44d104 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 200 len: 1558 microversion: 2.1 time: 0.240916 Apr 12 03:58:44 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 350/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:58:44 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 1558 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-72b4b8cc-5213-4192-9e90-fe00c80876cd req-010d2112-6d5b-481a-bc1a-587844857d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-unplugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-72b4b8cc-5213-4192-9e90-fe00c80876cd req-010d2112-6d5b-481a-bc1a-587844857d46 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-72b4b8cc-5213-4192-9e90-fe00c80876cd req-010d2112-6d5b-481a-bc1a-587844857d46 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:44 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-72b4b8cc-5213-4192-9e90-fe00c80876cd req-010d2112-6d5b-481a-bc1a-587844857d46 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-72b4b8cc-5213-4192-9e90-fe00c80876cd req-010d2112-6d5b-481a-bc1a-587844857d46 service nova] Creating event network-vif-unplugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:58:44 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-72b4b8cc-5213-4192-9e90-fe00c80876cd req-010d2112-6d5b-481a-bc1a-587844857d46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034923 Apr 12 03:58:44 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 350/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:46 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-0a381734-0f76-4094-98c5-2dfdd3a15128 req-d02496de-82fb-485a-91d5-7a3a385812c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-deleted", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0a381734-0f76-4094-98c5-2dfdd3a15128 req-d02496de-82fb-485a-91d5-7a3a385812c1 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0a381734-0f76-4094-98c5-2dfdd3a15128 req-d02496de-82fb-485a-91d5-7a3a385812c1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:46 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-0a381734-0f76-4094-98c5-2dfdd3a15128 req-d02496de-82fb-485a-91d5-7a3a385812c1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-0a381734-0f76-4094-98c5-2dfdd3a15128 req-d02496de-82fb-485a-91d5-7a3a385812c1 service nova] Creating event network-vif-deleted:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:58:46 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-0a381734-0f76-4094-98c5-2dfdd3a15128 req-d02496de-82fb-485a-91d5-7a3a385812c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050787 Apr 12 03:58:46 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 349/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:46 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-6aa51772-1356-46cd-9bc6-11e79da80955 req-2ebc5732-a6e5-4557-8e1e-44a7a024bef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4dae15-f69f-4e44-959a-7480e185020b", "name": "network-vif-plugged", "status": "completed", "tag": "1be56e0c-9ee5-4df6-bbd6-f866a4e54e90"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:58:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6aa51772-1356-46cd-9bc6-11e79da80955 req-2ebc5732-a6e5-4557-8e1e-44a7a024bef3 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6aa51772-1356-46cd-9bc6-11e79da80955 req-2ebc5732-a6e5-4557-8e1e-44a7a024bef3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:46 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-6aa51772-1356-46cd-9bc6-11e79da80955 req-2ebc5732-a6e5-4557-8e1e-44a7a024bef3 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-6aa51772-1356-46cd-9bc6-11e79da80955 req-2ebc5732-a6e5-4557-8e1e-44a7a024bef3 service nova] Creating event network-vif-plugged:1be56e0c-9ee5-4df6-bbd6-f866a4e54e90 for instance 1e4dae15-f69f-4e44-959a-7480e185020b on user Apr 12 03:58:46 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-6aa51772-1356-46cd-9bc6-11e79da80955 req-2ebc5732-a6e5-4557-8e1e-44a7a024bef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027920 Apr 12 03:58:46 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 351/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] [instance: faa9190f-a85c-4107-9c7c-3de959b5d4d0] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] HTTP exception thrown: Instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 could not be found. Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Request method failure captured: Apr 12 03:58:47 user devstack@n-api.service[62073]: request: GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0 HTTP/1.1 Apr 12 03:58:47 user devstack@n-api.service[62073]: Accept: application/json Apr 12 03:58:47 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 03:58:47 user devstack@n-api.service[62073]: Connection: close Apr 12 03:58:47 user devstack@n-api.service[62073]: Content-Length: 0 Apr 12 03:58:47 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 03:58:47 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 03:58:47 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 03:58:47 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNivOWixPodPkF8z8GJ50UyL-G1_7YtoDPF1pORDsJz2Kl9I-ctY6kOnh5j6ttBSA4dujLoeeY87Of17LS97pTxHj98X7nAcIHHTm-uhX8gEmIR3wPR_enfg8zG4bSYdwxXGY0wTmZC2Bh0_FrLnwhx_2BWQgxUeJdCcRbhIhRyplPsI Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Project-Id: b4b1260a71aa436081e636ca7b996ead Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Project-Name: tempest-VolumesActionsTest-437031612 Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4b1260a71aa436081e636ca7b996ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4b1260a71aa436081e636ca7b996ead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4b1260a71aa436081e636ca7b996ead"}]}] Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Tenant: tempest-VolumesActionsTest-437031612 Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Tenant-Id: b4b1260a71aa436081e636ca7b996ead Apr 12 03:58:47 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-VolumesActionsTest-437031612 Apr 12 03:58:47 user devstack@n-api.service[62073]: X-User: tempest-VolumesActionsTest-437031612-project-member Apr 12 03:58:47 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 03:58:47 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 03:58:47 user devstack@n-api.service[62073]: X-User-Id: 79bd18d6965c4f85bbbc121864fe5782 Apr 12 03:58:47 user devstack@n-api.service[62073]: X-User-Name: tempest-VolumesActionsTest-437031612-project-member Apr 12 03:58:47 user devstack@n-api.service[62073]: method: > Apr 12 03:58:47 user devstack@n-api.service[62073]: exception: Instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 could not be found. Apr 12 03:58:47 user devstack@n-api.service[62073]: action_args: {'id': 'faa9190f-a85c-4107-9c7c-3de959b5d4d0'} Apr 12 03:58:47 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 could not be found. Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 could not be found. Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 could not be found. Apr 12 03:58:47 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 03:58:47 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] Returning 404 to user: Instance faa9190f-a85c-4107-9c7c-3de959b5d4d0 could not be found. {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:58:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-fdb319cd-e5d6-4fe5-810f-83f7bc8fe370 tempest-VolumesActionsTest-437031612 tempest-VolumesActionsTest-437031612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0" status: 404 len: 111 microversion: 2.1 time: 0.033113 Apr 12 03:58:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 351/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:58:47 2023] GET /compute/v2.1/servers/faa9190f-a85c-4107-9c7c-3de959b5d4d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:58:57 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:58:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4e7008c5-12ac-4451-b8c7-3e444286e97a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 200 len: 1504 microversion: 2.1 time: 0.210039 Apr 12 03:58:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 350/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:58:57 2023] GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] [instance: 1e4dae15-f69f-4e44-959a-7480e185020b] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] HTTP exception thrown: Instance 1e4dae15-f69f-4e44-959a-7480e185020b could not be found. Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Request method failure captured: Apr 12 03:59:34 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b HTTP/1.1 Apr 12 03:59:34 user devstack@n-api.service[62072]: Accept: application/json Apr 12 03:59:34 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 03:59:34 user devstack@n-api.service[62072]: Connection: close Apr 12 03:59:34 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 03:59:34 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 03:59:34 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 03:59:34 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 03:59:34 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNisZgNMLJQZMHCf_v2hYMlA8qWd9-xyoaVqPxsVJ8j-1tsCZ6JB-a9UclAkT-uWEIZAdsAIRmv2L81dYplOJLjOn4Fid2KC_nVv04_4cnlEty_7FAdeL8sHBdNcmr-pJgASkbzvNcUzE8FjC1ps00DGYoWoTzu4ezKwrM7sNy_jKqKk Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Project-Id: d8ec2318ea05403db924630461ea77e5 Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Project-Name: tempest-TestShelveInstance-130328817 Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ec2318ea05403db924630461ea77e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ec2318ea05403db924630461ea77e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ec2318ea05403db924630461ea77e5"}]}] Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Tenant: tempest-TestShelveInstance-130328817 Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Tenant-Id: d8ec2318ea05403db924630461ea77e5 Apr 12 03:59:34 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-TestShelveInstance-130328817 Apr 12 03:59:34 user devstack@n-api.service[62072]: X-User: tempest-TestShelveInstance-130328817-project-member Apr 12 03:59:34 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 03:59:34 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 03:59:34 user devstack@n-api.service[62072]: X-User-Id: 447437f9d71b4f8ab0da168f0fca732f Apr 12 03:59:34 user devstack@n-api.service[62072]: X-User-Name: tempest-TestShelveInstance-130328817-project-member Apr 12 03:59:34 user devstack@n-api.service[62072]: method: > Apr 12 03:59:34 user devstack@n-api.service[62072]: exception: Instance 1e4dae15-f69f-4e44-959a-7480e185020b could not be found. Apr 12 03:59:34 user devstack@n-api.service[62072]: action_args: {'id': '1e4dae15-f69f-4e44-959a-7480e185020b'} Apr 12 03:59:34 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e4dae15-f69f-4e44-959a-7480e185020b could not be found. Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e4dae15-f69f-4e44-959a-7480e185020b could not be found. Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e4dae15-f69f-4e44-959a-7480e185020b could not be found. Apr 12 03:59:34 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 03:59:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Returning 404 to user: Instance 1e4dae15-f69f-4e44-959a-7480e185020b could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 03:59:34 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-7cac63f3-2eea-416c-b76f-6bfa12a5f9d8 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b" status: 404 len: 111 microversion: 2.1 time: 0.038111 Apr 12 03:59:34 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 352/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:59:34 2023] GET /compute/v2.1/servers/1e4dae15-f69f-4e44-959a-7480e185020b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 03:59:34 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a374405b-fd75-4db5-be3b-eda94efc0523 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] Calling method '.version_select at 0x7f76a6ff1bd0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:59:34 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:34 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:34 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a374405b-fd75-4db5-be3b-eda94efc0523 tempest-TestShelveInstance-130328817 tempest-TestShelveInstance-130328817-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1986276884" status: 202 len: 0 microversion: 2.1 time: 0.027905 Apr 12 03:59:34 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 352/1054] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 03:59:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1986276884 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 03:59:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:54 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d97e67c8-c79b-42ff-864c-062757a3c2bb tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Action: 'create', calling method: .version_select at 0x7f76a682b760>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-272659456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS5zNm2ebJK6LG9OrL+ojzX+EwxzS/Yi0eAvnaL94lZQddER4Le1QtAFpoIWWwQszoaOHdLJaBYOeLou7nEAtCK/7ohtIg1OU5j5fJMB0C0xARTUV1WXA8kI8LAoQVCtA=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:59:54 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-d97e67c8-c79b-42ff-864c-062757a3c2bb tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Getting quotas for project 01223543586e474b875e7dbf2c78ef87. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:59:54 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-d97e67c8-c79b-42ff-864c-062757a3c2bb tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Getting quotas for user dc05e2e474814697920e72d50883e263 and project 01223543586e474b875e7dbf2c78ef87. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:59:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d97e67c8-c79b-42ff-864c-062757a3c2bb tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.288784 Apr 12 03:59:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 351/1055] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 03:59:54 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 03:59:55 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1263744278", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-272659456", "security_groups": [{"name": "tempest-secgroup-smoke-1628327375"}], "networks": [{"uuid": "1298d27c-9dfa-46e2-b941-024dd99ead79"}]}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:59:55 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:55 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.network.neutron [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] validate_networks() for [('1298d27c-9dfa-46e2-b941-024dd99ead79', None, None, None, None, None)] {{(pid=62072) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Flavor limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Image limits 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Flavor pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Image pref 0:0:0 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.virt.hardware [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Getting quotas for project 01223543586e474b875e7dbf2c78ef87. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.quota [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Getting quotas for user dc05e2e474814697920e72d50883e263 and project 01223543586e474b875e7dbf2c78ef87. Resources: {'ram', 'instances', 'cores'} {{(pid=62072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Going to run 1 instances... {{(pid=62072) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 03:59:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 03:59:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-2fa29020-cf11-45a7-a3ae-2df23c043582 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.879298 Apr 12 03:59:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 353/1056] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 03:59:55 2023] POST /compute/v2.1/servers => generated 404 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 03:59:56 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 03:59:56 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-6524680b-d3e1-43db-b216-ea9cbdc8fc73 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:59:56 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-6524680b-d3e1-43db-b216-ea9cbdc8fc73 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:59:56 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-6524680b-d3e1-43db-b216-ea9cbdc8fc73 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc05e2e474814697920e72d50883e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01223543586e474b875e7dbf2c78ef87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:59:56 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-6524680b-d3e1-43db-b216-ea9cbdc8fc73 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489" status: 200 len: 1256 microversion: 2.1 time: 0.084345 Apr 12 03:59:56 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 353/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:59:56 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 => generated 1256 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:57 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:58 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lazy-loading 'flavor' on Instance uuid 6cd92d70-a2af-4b2a-97c3-2981c157278d {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 03:59:58 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-d3f7d821-2946-49a0-93b1-d08640d5d5d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d/action" status: 200 len: 32 microversion: 2.1 time: 0.105960 Apr 12 03:59:58 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 352/1058] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 03:59:57 2023] POST /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d/action => generated 32 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:58 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 03:59:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-bb888680-01e9-456c-89e9-3905a3e4dc85 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 200 len: 1510 microversion: 2.1 time: 0.169558 Apr 12 03:59:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 354/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 03:59:58 2023] GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 03:59:59 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-f4e935df-bb58-48eb-be18-4500e5f9305d req-f5f3bf5d-ebed-4c98-8ca7-5d34840b85ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-unplugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 03:59:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f4e935df-bb58-48eb-be18-4500e5f9305d req-f5f3bf5d-ebed-4c98-8ca7-5d34840b85ce service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 03:59:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f4e935df-bb58-48eb-be18-4500e5f9305d req-f5f3bf5d-ebed-4c98-8ca7-5d34840b85ce service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 03:59:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-f4e935df-bb58-48eb-be18-4500e5f9305d req-f5f3bf5d-ebed-4c98-8ca7-5d34840b85ce service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 03:59:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-f4e935df-bb58-48eb-be18-4500e5f9305d req-f5f3bf5d-ebed-4c98-8ca7-5d34840b85ce service nova] Creating event network-vif-unplugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 03:59:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-f4e935df-bb58-48eb-be18-4500e5f9305d req-f5f3bf5d-ebed-4c98-8ca7-5d34840b85ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031699 Apr 12 03:59:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 354/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 03:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:00:00 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-d0f4e2a9-a59d-4634-92e3-2c312584b22d req-8ac3518f-2c02-4024-9a21-6a0889ccc596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:00:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-d0f4e2a9-a59d-4634-92e3-2c312584b22d req-8ac3518f-2c02-4024-9a21-6a0889ccc596 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-d0f4e2a9-a59d-4634-92e3-2c312584b22d req-8ac3518f-2c02-4024-9a21-6a0889ccc596 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:00 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-d0f4e2a9-a59d-4634-92e3-2c312584b22d req-8ac3518f-2c02-4024-9a21-6a0889ccc596 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-d0f4e2a9-a59d-4634-92e3-2c312584b22d req-8ac3518f-2c02-4024-9a21-6a0889ccc596 service nova] Creating event network-changed:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:00:00 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-d0f4e2a9-a59d-4634-92e3-2c312584b22d req-8ac3518f-2c02-4024-9a21-6a0889ccc596 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040714 Apr 12 04:00:00 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 353/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:00:01 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-995569ff-6838-4ac6-a3cc-036baa3a5340 req-de0d60fd-1b8f-4397-b126-0c8dcc5deb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-plugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:00:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-995569ff-6838-4ac6-a3cc-036baa3a5340 req-de0d60fd-1b8f-4397-b126-0c8dcc5deb93 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-995569ff-6838-4ac6-a3cc-036baa3a5340 req-de0d60fd-1b8f-4397-b126-0c8dcc5deb93 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:01 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-995569ff-6838-4ac6-a3cc-036baa3a5340 req-de0d60fd-1b8f-4397-b126-0c8dcc5deb93 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-995569ff-6838-4ac6-a3cc-036baa3a5340 req-de0d60fd-1b8f-4397-b126-0c8dcc5deb93 service nova] Creating event network-vif-plugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 04:00:01 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-995569ff-6838-4ac6-a3cc-036baa3a5340 req-de0d60fd-1b8f-4397-b126-0c8dcc5deb93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032128 Apr 12 04:00:01 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 355/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:00:02 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-c168d57b-1e4c-4de6-bea6-839c8fbd9cbe req-6faf4204-19e6-4438-86ad-0929ca9935f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "name": "network-vif-plugged", "status": "completed", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:00:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c168d57b-1e4c-4de6-bea6-839c8fbd9cbe req-6faf4204-19e6-4438-86ad-0929ca9935f7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c168d57b-1e4c-4de6-bea6-839c8fbd9cbe req-6faf4204-19e6-4438-86ad-0929ca9935f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c168d57b-1e4c-4de6-bea6-839c8fbd9cbe req-6faf4204-19e6-4438-86ad-0929ca9935f7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c168d57b-1e4c-4de6-bea6-839c8fbd9cbe req-6faf4204-19e6-4438-86ad-0929ca9935f7 service nova] Creating event network-vif-plugged:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:00:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-c168d57b-1e4c-4de6-bea6-839c8fbd9cbe req-6faf4204-19e6-4438-86ad-0929ca9935f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Apr 12 04:00:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 355/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:00:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-plugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}, {"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-plugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:00:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] Creating event network-vif-plugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 04:00:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] Creating event network-vif-plugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 04:00:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-f50c2fd4-e9f5-4004-853b-2433c9452d11 req-cb43babd-2e99-4a5e-9763-d2ccfefbccd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031630 Apr 12 04:00:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 354/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:00:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c6687a66-2ab9-4731-96e4-e6aaac1d3a17 req-9085985f-12a5-47e4-b41a-26e7a6c60fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "name": "network-vif-plugged", "status": "completed", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:00:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c6687a66-2ab9-4731-96e4-e6aaac1d3a17 req-9085985f-12a5-47e4-b41a-26e7a6c60fe2 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c6687a66-2ab9-4731-96e4-e6aaac1d3a17 req-9085985f-12a5-47e4-b41a-26e7a6c60fe2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c6687a66-2ab9-4731-96e4-e6aaac1d3a17 req-9085985f-12a5-47e4-b41a-26e7a6c60fe2 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c6687a66-2ab9-4731-96e4-e6aaac1d3a17 req-9085985f-12a5-47e4-b41a-26e7a6c60fe2 service nova] Creating event network-vif-plugged:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:00:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c6687a66-2ab9-4731-96e4-e6aaac1d3a17 req-9085985f-12a5-47e4-b41a-26e7a6c60fe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030388 Apr 12 04:00:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 356/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=8 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:46 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:47 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc05e2e474814697920e72d50883e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01223543586e474b875e7dbf2c78ef87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:00:47 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-73840b36-ef46-4a9d-938a-f3d6059f6367 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489" status: 200 len: 1568 microversion: 2.1 time: 0.204381 Apr 12 04:00:47 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 356/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:00:46 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:00:48 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:00:48 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-4aa6c487-4f0c-44f2-9d0e-9aa0c3439b68 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 200 len: 1490 microversion: 2.1 time: 0.163913 Apr 12 04:00:48 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 355/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:00:48 2023] GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 1490 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=12 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:47 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc05e2e474814697920e72d50883e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01223543586e474b875e7dbf2c78ef87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:01:47 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-67b8cb4c-78a6-45d8-a69c-adf29781d182 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489" status: 200 len: 1568 microversion: 2.1 time: 0.221780 Apr 12 04:01:47 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 357/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:01:47 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:48 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:01:48 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ec2828e7-4612-49aa-b832-206ad5332d45 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1504 microversion: 2.1 time: 0.257933 Apr 12 04:01:48 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 357/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:01:48 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:01:50 user devstack@n-api.service[62074]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dcb4d780-1fb1-459e-be04-d579607464d3] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 04:01:50 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:50 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:01:50 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-c5157125-b3e5-436d-ac82-06bf77a9742c req-299b2c1a-c169-4e0e-a990-97f87db32c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:01:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c5157125-b3e5-436d-ac82-06bf77a9742c req-299b2c1a-c169-4e0e-a990-97f87db32c7d service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c5157125-b3e5-436d-ac82-06bf77a9742c req-299b2c1a-c169-4e0e-a990-97f87db32c7d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:50 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-c5157125-b3e5-436d-ac82-06bf77a9742c req-299b2c1a-c169-4e0e-a990-97f87db32c7d service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-c5157125-b3e5-436d-ac82-06bf77a9742c req-299b2c1a-c169-4e0e-a990-97f87db32c7d service nova] Creating event network-changed:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:01:50 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-c5157125-b3e5-436d-ac82-06bf77a9742c req-299b2c1a-c169-4e0e-a990-97f87db32c7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067577 Apr 12 04:01:50 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 356/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:01:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c443292-90f6-4823-bfa7-fdec2393e3fe"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:01:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:01:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1dced3f3-ebe9-4af2-b9de-ca0ffce9a0f0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297989 Apr 12 04:01:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 358/1071] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 04:01:50 2023] POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:05 user devstack@n-api.service[62073]: DEBUG nova.objects.instance [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lazy-loading 'services' on Instance uuid 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 {{(pid=62073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:02:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f34abe42-537f-4d27-9cbd-208290c96fab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/9c443292-90f6-4823-bfa7-fdec2393e3fe" status: 202 len: 0 microversion: 2.1 time: 0.171167 Apr 12 04:02:05 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 358/1072] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 04:02:05 2023] DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/9c443292-90f6-4823-bfa7-fdec2393e3fe => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:05 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] [dcb4d780-1fb1-459e-be04-d579607464d3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50662. Apr 12 04:02:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8ee1305d-4770-495e-af17-a6648bed273a tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052727 Apr 12 04:02:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 357/1073] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:02:05 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:50 user devstack@n-api.service[62072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:02:50 user devstack@n-api.service[62072]: Wed Apr 12 04:02:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/action (ip 10.0.0.210) !!! Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:50 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lazy-loading 'flavor' on Instance uuid de40e137-84e3-4d85-895b-1f6da2673457 {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:02:50 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4f471705-eefc-426a-81b4-fe3a47ad8408 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/action" status: 200 len: 32 microversion: 2.1 time: 0.114160 Apr 12 04:02:50 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 359/1074] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 04:02:50 2023] POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:50 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:02:50 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cbe9d8b9-7259-41e8-925f-92fd64b6b3f1 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1510 microversion: 2.1 time: 0.231294 Apr 12 04:02:50 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 359/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:02:50 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:02:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:51 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:02:51 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-f21b6864-b687-45ad-ab06-5342b8313f9b req-ddd3665e-bb51-434b-b4a4-461750f9c201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-unplugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:02:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f21b6864-b687-45ad-ab06-5342b8313f9b req-ddd3665e-bb51-434b-b4a4-461750f9c201 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f21b6864-b687-45ad-ab06-5342b8313f9b req-ddd3665e-bb51-434b-b4a4-461750f9c201 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:51 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-f21b6864-b687-45ad-ab06-5342b8313f9b req-ddd3665e-bb51-434b-b4a4-461750f9c201 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-f21b6864-b687-45ad-ab06-5342b8313f9b req-ddd3665e-bb51-434b-b4a4-461750f9c201 service nova] Creating event network-vif-unplugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:02:51 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-f21b6864-b687-45ad-ab06-5342b8313f9b req-ddd3665e-bb51-434b-b4a4-461750f9c201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085440 Apr 12 04:02:51 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 358/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:02:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-98fbb7db-917b-4999-a087-df5e777fba91 req-8cb889fe-59c8-495d-a617-159685289815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:02:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-98fbb7db-917b-4999-a087-df5e777fba91 req-8cb889fe-59c8-495d-a617-159685289815 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-98fbb7db-917b-4999-a087-df5e777fba91 req-8cb889fe-59c8-495d-a617-159685289815 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-98fbb7db-917b-4999-a087-df5e777fba91 req-8cb889fe-59c8-495d-a617-159685289815 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-98fbb7db-917b-4999-a087-df5e777fba91 req-8cb889fe-59c8-495d-a617-159685289815 service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:02:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-98fbb7db-917b-4999-a087-df5e777fba91 req-8cb889fe-59c8-495d-a617-159685289815 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051669 Apr 12 04:02:53 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 360/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:02:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:55 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}, {"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:02:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:02:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:02:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-5c3f944b-5179-457d-b2c2-330318e4d943 req-0783cdfd-937b-4ca9-86fd-42510c22936c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032837 Apr 12 04:02:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 359/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:02:55 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-04a801ba-2cdf-42a6-916b-71ccd8aeafab tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069357 Apr 12 04:02:55 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 360/1079] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:02:55 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4b84f00-ee57-457a-924e-f2d7f2aada61"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:02:58 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:02:58 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-69ea65f4-ad02-4b17-8433-b0b3c874a990 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313788 Apr 12 04:02:58 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 361/1080] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 04:02:58 2023] POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:05 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lazy-loading 'services' on Instance uuid 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:03:05 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f86fba55-abb3-4211-9e85-f48f73ca9b05 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/c4b84f00-ee57-457a-924e-f2d7f2aada61" status: 202 len: 0 microversion: 2.1 time: 0.289582 Apr 12 04:03:05 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 360/1081] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 04:03:05 2023] DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/c4b84f00-ee57-457a-924e-f2d7f2aada61 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=12 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:05 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:05 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-b0439e50-71b2-4fa5-bf5b-0e62cc32e46e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057763 Apr 12 04:03:05 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 361/1082] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:03:05 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:40 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:03:40 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-034c31a8-c8ed-4164-8250-0b1ad1238010 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1490 microversion: 2.1 time: 0.290551 Apr 12 04:03:40 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 362/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:03:40 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1490 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 04:03:55 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:03:55 user devstack@n-api.service[62074]: Wed Apr 12 04:03:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:55 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:55 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-a8ae40f1-4f39-4b20-9b04-56233294f9af tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053564 Apr 12 04:03:55 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 361/1084] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:03:55 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74d431c2-3cc6-458a-bc7b-c267be57fb16"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:03:58 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:03:58 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-c6ab5b78-525a-4882-923c-0d96fcc2401e tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287739 Apr 12 04:03:58 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 362/1085] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 04:03:58 2023] POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:05 user devstack@n-api.service[62072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:04:05 user devstack@n-api.service[62072]: Wed Apr 12 04:04:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/74d431c2-3cc6-458a-bc7b-c267be57fb16 (ip 10.0.0.210) !!! Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:06 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lazy-loading 'services' on Instance uuid 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:04:06 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d84ab057-248c-4646-b027-81da130f4a20 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/74d431c2-3cc6-458a-bc7b-c267be57fb16" status: 202 len: 0 microversion: 2.1 time: 0.202922 Apr 12 04:04:06 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 363/1086] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 04:04:05 2023] DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/74d431c2-3cc6-458a-bc7b-c267be57fb16 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-0c26c0e0-d56b-448f-9816-ec1c3aec2fd5 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Apr 12 04:04:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 362/1087] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:04:06 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f861719-1271-4805-aac7-2aa5201ed449"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.wsgi [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] HTTP exception thrown: Cannot 'attach_volume' instance de40e137-84e3-4d85-895b-1f6da2673457 while it is in vm_state rescued Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Request method failure captured: Apr 12 04:04:40 user devstack@n-api.service[62073]: request: POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/os-volume_attachments HTTP/1.1 Apr 12 04:04:40 user devstack@n-api.service[62073]: Accept: application/json Apr 12 04:04:40 user devstack@n-api.service[62073]: Accept-Encoding: identity Apr 12 04:04:40 user devstack@n-api.service[62073]: Connection: close Apr 12 04:04:40 user devstack@n-api.service[62073]: Content-Length: 74 Apr 12 04:04:40 user devstack@n-api.service[62073]: Content-Type: application/json Apr 12 04:04:40 user devstack@n-api.service[62073]: Host: 10.0.0.210 Apr 12 04:04:40 user devstack@n-api.service[62073]: Openstack-System-Scope: None Apr 12 04:04:40 user devstack@n-api.service[62073]: User-Agent: python-urllib3/1.26.15 Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Auth-Token: gAAAAABkNixNbgyTKivc6fZWz-HRQFpqAEHSiU_1M9f-xTEdO4zRmuH9O5bBX96S98UL4mcgUFvqGOVQ0787Gkk4acAPG2u4xsxNKH19R_FGY4f3KyRJqEJNNfGNBnQeom-yvkccKqmtQgh5qLXsZSmW9Yy6pbtbQNs16oFIeciP9C45MSJb7j8 Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Domain-Id: None Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Domain-Name: None Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Identity-Status: Confirmed Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Is-Admin-Project: True Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Project-Domain-Id: default Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Project-Domain-Name: Default Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Project-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Role: reader,member Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Roles: reader,member Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}] Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Tenant: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Tenant-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:04:40 user devstack@n-api.service[62073]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:04:40 user devstack@n-api.service[62073]: X-User: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:04:40 user devstack@n-api.service[62073]: X-User-Domain-Id: default Apr 12 04:04:40 user devstack@n-api.service[62073]: X-User-Domain-Name: Default Apr 12 04:04:40 user devstack@n-api.service[62073]: X-User-Id: 44a0206f1323440db4f8411a3c3c088d Apr 12 04:04:40 user devstack@n-api.service[62073]: X-User-Name: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:04:40 user devstack@n-api.service[62073]: Apr 12 04:04:40 user devstack@n-api.service[62073]: {"volumeAttachment": {"volumeId": "6f861719-1271-4805-aac7-2aa5201ed449"}} Apr 12 04:04:40 user devstack@n-api.service[62073]: method: > Apr 12 04:04:40 user devstack@n-api.service[62073]: exception: Cannot 'attach_volume' instance de40e137-84e3-4d85-895b-1f6da2673457 while it is in vm_state rescued Apr 12 04:04:40 user devstack@n-api.service[62073]: action_args: {'server_id': 'de40e137-84e3-4d85-895b-1f6da2673457', 'body': {'volumeAttachment': {'volumeId': '6f861719-1271-4805-aac7-2aa5201ed449'}}} Apr 12 04:04:40 user devstack@n-api.service[62073]: {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance de40e137-84e3-4d85-895b-1f6da2673457 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance de40e137-84e3-4d85-895b-1f6da2673457 while it is in vm_state rescued Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance de40e137-84e3-4d85-895b-1f6da2673457 while it is in vm_state rescued Apr 12 04:04:40 user devstack@n-api.service[62073]: ERROR nova.api.openstack.wsgi Apr 12 04:04:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Returning 409 to user: Cannot 'attach_volume' instance de40e137-84e3-4d85-895b-1f6da2673457 while it is in vm_state rescued {{(pid=62073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 04:04:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-cf169106-2a53-4d0c-8cb4-f716391d151c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055661 Apr 12 04:04:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 363/1088] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 04:04:40 2023] POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:41 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:41 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-4f2f11fd-dcc1-4015-86b5-48a78b695204 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/action" status: 202 len: 0 microversion: 2.1 time: 0.089998 Apr 12 04:04:41 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 364/1089] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 04:04:40 2023] POST /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:41 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:04:41 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8b464556-bffe-453c-9315-ba39dc871722 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1498 microversion: 2.1 time: 0.235922 Apr 12 04:04:41 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 363/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:04:41 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:04:41 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d0d6a52a-7957-4af1-99aa-93208a13cf8a req-368437f8-a3a3-4eb8-a189-9edca2a831df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-unplugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:04:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d0d6a52a-7957-4af1-99aa-93208a13cf8a req-368437f8-a3a3-4eb8-a189-9edca2a831df service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d0d6a52a-7957-4af1-99aa-93208a13cf8a req-368437f8-a3a3-4eb8-a189-9edca2a831df service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:41 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d0d6a52a-7957-4af1-99aa-93208a13cf8a req-368437f8-a3a3-4eb8-a189-9edca2a831df service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d0d6a52a-7957-4af1-99aa-93208a13cf8a req-368437f8-a3a3-4eb8-a189-9edca2a831df service nova] Creating event network-vif-unplugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:04:41 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d0d6a52a-7957-4af1-99aa-93208a13cf8a req-368437f8-a3a3-4eb8-a189-9edca2a831df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032787 Apr 12 04:04:41 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 364/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:04:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:04:43 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}, {"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}, {"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:04:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:43 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:04:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:04:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:04:43 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-03e5b478-a5fa-428f-ac77-da2550726ace req-45fa8556-3bcc-4147-9488-56fc15e2dcf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035877 Apr 12 04:04:43 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 365/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:04:43 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:56 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:56 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-0b2661b1-8aa1-4bad-95bf-566cb7ecb8a0 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171743 Apr 12 04:04:56 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 364/1093] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:04:56 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:04:58 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "463340ee-e367-446f-adf5-411c52acf103"}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:04:58 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:04:59 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:04:59 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a4dc659b-78c7-4131-a91e-8e29895fe5fc tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274553 Apr 12 04:04:59 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 365/1094] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 04:04:58 2023] POST /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:06 user devstack@n-api.service[62072]: DEBUG nova.objects.instance [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lazy-loading 'services' on Instance uuid 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 {{(pid=62072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:05:06 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-776a89e5-dd1c-48c3-8f98-3f668b1284ed tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/463340ee-e367-446f-adf5-411c52acf103" status: 202 len: 0 microversion: 2.1 time: 0.173448 Apr 12 04:05:06 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 366/1095] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 04:05:06 2023] DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments/463340ee-e367-446f-adf5-411c52acf103 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:06 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:06 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-da287d94-5b02-40cd-97fa-56f8c1a11952 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052920 Apr 12 04:05:06 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 365/1096] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:05:06 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:31 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:05:31 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-44eafe93-07b7-4375-b9a3-d57564039f43 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1504 microversion: 2.1 time: 0.157306 Apr 12 04:05:31 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 366/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:05:31 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:05:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:05:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-f616293a-615b-43d3-9135-7d8ec9a09843 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055843 Apr 12 04:05:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 367/1098] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:05:56 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:06:07 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:07 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=12 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-dd8bea29-07b4-40b7-bba9-5810e8efb5f4 req-e42d025d-07a3-429a-91d7-f8b8aef43d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd8bea29-07b4-40b7-bba9-5810e8efb5f4 req-e42d025d-07a3-429a-91d7-f8b8aef43d3e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd8bea29-07b4-40b7-bba9-5810e8efb5f4 req-e42d025d-07a3-429a-91d7-f8b8aef43d3e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd8bea29-07b4-40b7-bba9-5810e8efb5f4 req-e42d025d-07a3-429a-91d7-f8b8aef43d3e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-dd8bea29-07b4-40b7-bba9-5810e8efb5f4 req-e42d025d-07a3-429a-91d7-f8b8aef43d3e service nova] Creating event network-changed:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:06:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-dd8bea29-07b4-40b7-bba9-5810e8efb5f4 req-e42d025d-07a3-429a-91d7-f8b8aef43d3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108697 Apr 12 04:06:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 366/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:09 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 04:06:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4a3a1277-86e9-478f-a012-acd090ae130c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489" status: 204 len: 0 microversion: 2.1 time: 0.117825 Apr 12 04:06:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 367/1100] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 04:06:09 2023] DELETE /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:09 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc05e2e474814697920e72d50883e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01223543586e474b875e7dbf2c78ef87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:06:09 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-1bff5cf5-338b-48e7-821d-08cbbd805b3c tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489" status: 200 len: 1574 microversion: 2.1 time: 0.192133 Apr 12 04:06:09 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 368/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:06:09 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:06:10 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-7af60b53-8fdc-48a4-91fa-d54b256c4890 req-9d8c1c6f-ba00-4243-8ce6-8bfd8f04a13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "name": "network-vif-unplugged", "status": "completed", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7af60b53-8fdc-48a4-91fa-d54b256c4890 req-9d8c1c6f-ba00-4243-8ce6-8bfd8f04a13c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7af60b53-8fdc-48a4-91fa-d54b256c4890 req-9d8c1c6f-ba00-4243-8ce6-8bfd8f04a13c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:10 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-7af60b53-8fdc-48a4-91fa-d54b256c4890 req-9d8c1c6f-ba00-4243-8ce6-8bfd8f04a13c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:10 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-7af60b53-8fdc-48a4-91fa-d54b256c4890 req-9d8c1c6f-ba00-4243-8ce6-8bfd8f04a13c service nova] Creating event network-vif-unplugged:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:06:10 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-7af60b53-8fdc-48a4-91fa-d54b256c4890 req-9d8c1c6f-ba00-4243-8ce6-8bfd8f04a13c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033995 Apr 12 04:06:10 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 367/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:11 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-63dd59f9-29cb-4f55-bd52-0a83e8f84f6e req-d2ab4da9-1572-486f-8abd-992af1507d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "name": "network-vif-deleted", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-63dd59f9-29cb-4f55-bd52-0a83e8f84f6e req-d2ab4da9-1572-486f-8abd-992af1507d09 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-63dd59f9-29cb-4f55-bd52-0a83e8f84f6e req-d2ab4da9-1572-486f-8abd-992af1507d09 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:11 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-63dd59f9-29cb-4f55-bd52-0a83e8f84f6e req-d2ab4da9-1572-486f-8abd-992af1507d09 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-63dd59f9-29cb-4f55-bd52-0a83e8f84f6e req-d2ab4da9-1572-486f-8abd-992af1507d09 service nova] Creating event network-vif-deleted:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:06:11 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-63dd59f9-29cb-4f55-bd52-0a83e8f84f6e req-d2ab4da9-1572-486f-8abd-992af1507d09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089199 Apr 12 04:06:11 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 368/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:12 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-a041c1be-b685-445d-a351-cf232ac3679f req-8d5b4791-891f-44bd-8ced-2dfb5aaa66f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6fb26c-9c8f-4be7-b16f-8662eed2e489", "name": "network-vif-plugged", "status": "completed", "tag": "c83728df-a614-42d7-a164-d5d5e0373838"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a041c1be-b685-445d-a351-cf232ac3679f req-8d5b4791-891f-44bd-8ced-2dfb5aaa66f9 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a041c1be-b685-445d-a351-cf232ac3679f req-8d5b4791-891f-44bd-8ced-2dfb5aaa66f9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:12 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-a041c1be-b685-445d-a351-cf232ac3679f req-8d5b4791-891f-44bd-8ced-2dfb5aaa66f9 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-a041c1be-b685-445d-a351-cf232ac3679f req-8d5b4791-891f-44bd-8ced-2dfb5aaa66f9 service nova] Creating event network-vif-plugged:c83728df-a614-42d7-a164-d5d5e0373838 for instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 on user Apr 12 04:06:12 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-a041c1be-b685-445d-a351-cf232ac3679f req-8d5b4791-891f-44bd-8ced-2dfb5aaa66f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038537 Apr 12 04:06:12 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 369/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:33 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:33 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-3ec19049-a277-4df0-ae86-e01634e3e2c4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'create', calling method: .version_select at 0x7f76a472f5b0>, body: {"keypair": {"name": "tempest-keypair-469921698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXMs69H3aVwHvUXehqGeCn+vQJTwljOWf0Mp9khd00+UAOaU6NKxayjTMFZ3zU9NHkMqh5MJ76PIyP2BqxywFz+m9V79UNQ6CkqenIlufndQEJ4s9KnY6yNND9omt/Bww=="}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:33 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-3ec19049-a277-4df0-ae86-e01634e3e2c4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 04:06:33 user devstack@n-api.service[62074]: DEBUG nova.quota [None req-3ec19049-a277-4df0-ae86-e01634e3e2c4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for user 44a0206f1323440db4f8411a3c3c088d and project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'key_pairs'} {{(pid=62074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 04:06:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-3ec19049-a277-4df0-ae86-e01634e3e2c4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066655 Apr 12 04:06:33 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 368/1105] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 04:06:33 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:34 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:34 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:34 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1315935319", "imageRef": "e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "311bda05-075c-4bb3-9469-b5117dd33353"}], "security_groups": [{"name": "tempest-securitygroup--583198095"}], "key_name": "tempest-keypair-469921698", "user_data": "}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:34 user devstack@n-api.service[62073]: DEBUG nova.network.neutron [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] validate_networks() for [('311bda05-075c-4bb3-9469-b5117dd33353', None, None, None, None, None)] {{(pid=62073) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Flavor limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Image limits 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Flavor pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Image pref 0:0:0 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.virt.hardware [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.quota [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Getting quotas for user 44a0206f1323440db4f8411a3c3c088d and project a6a8a4f5d59e479f9ca7b73a9e270c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=62073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Going to run 1 instances... {{(pid=62073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 04:06:35 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e93a44d0-4b8a-47a9-bc0e-cefc41cd7ee7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 04:06:35 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-bc722248-17da-4791-8637-fb935faf864a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.626672 Apr 12 04:06:35 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 369/1106] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 04:06:34 2023] POST /compute/v2.1/servers => generated 406 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 04:06:35 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:35 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:35 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-fac14715-0f55-4c3a-989f-5776ce91b58b tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:06:35 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-fac14715-0f55-4c3a-989f-5776ce91b58b tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:06:35 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-fac14715-0f55-4c3a-989f-5776ce91b58b tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:06:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-fac14715-0f55-4c3a-989f-5776ce91b58b tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1239 microversion: 2.1 time: 0.076406 Apr 12 04:06:35 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 370/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:06:35 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:06:38 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-dd381844-efcb-47bf-9edb-f31e1964ec65 req-bf65daae-452d-4c75-adc4-29ed23820dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd381844-efcb-47bf-9edb-f31e1964ec65 req-bf65daae-452d-4c75-adc4-29ed23820dc6 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd381844-efcb-47bf-9edb-f31e1964ec65 req-bf65daae-452d-4c75-adc4-29ed23820dc6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:38 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-dd381844-efcb-47bf-9edb-f31e1964ec65 req-bf65daae-452d-4c75-adc4-29ed23820dc6 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-dd381844-efcb-47bf-9edb-f31e1964ec65 req-bf65daae-452d-4c75-adc4-29ed23820dc6 service nova] Creating event network-changed:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:06:38 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-dd381844-efcb-47bf-9edb-f31e1964ec65 req-bf65daae-452d-4c75-adc4-29ed23820dc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033660 Apr 12 04:06:38 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 369/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:40 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-9949e9e1-ef25-40e9-b37e-30ae113de1f6 req-9ec7300a-e219-4482-a6bf-52bd1f29cb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9949e9e1-ef25-40e9-b37e-30ae113de1f6 req-9ec7300a-e219-4482-a6bf-52bd1f29cb56 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9949e9e1-ef25-40e9-b37e-30ae113de1f6 req-9ec7300a-e219-4482-a6bf-52bd1f29cb56 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:40 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-9949e9e1-ef25-40e9-b37e-30ae113de1f6 req-9ec7300a-e219-4482-a6bf-52bd1f29cb56 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-9949e9e1-ef25-40e9-b37e-30ae113de1f6 req-9ec7300a-e219-4482-a6bf-52bd1f29cb56 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:06:40 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-9949e9e1-ef25-40e9-b37e-30ae113de1f6 req-9ec7300a-e219-4482-a6bf-52bd1f29cb56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045597 Apr 12 04:06:40 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 370/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:42 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-4e056d41-cc8d-40b6-96a6-3594163bafd7 req-e1e5e170-30b8-4b78-9b26-315bf8a046f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:06:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4e056d41-cc8d-40b6-96a6-3594163bafd7 req-e1e5e170-30b8-4b78-9b26-315bf8a046f1 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4e056d41-cc8d-40b6-96a6-3594163bafd7 req-e1e5e170-30b8-4b78-9b26-315bf8a046f1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:42 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-4e056d41-cc8d-40b6-96a6-3594163bafd7 req-e1e5e170-30b8-4b78-9b26-315bf8a046f1 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-4e056d41-cc8d-40b6-96a6-3594163bafd7 req-e1e5e170-30b8-4b78-9b26-315bf8a046f1 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:06:42 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-4e056d41-cc8d-40b6-96a6-3594163bafd7 req-e1e5e170-30b8-4b78-9b26-315bf8a046f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029387 Apr 12 04:06:42 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 371/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell0:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] [instance: 7a6fb26c-9c8f-4be7-b16f-8662eed2e489] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:06:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] HTTP exception thrown: Instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 could not be found. Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Request method failure captured: Apr 12 04:06:59 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 HTTP/1.1 Apr 12 04:06:59 user devstack@n-api.service[62074]: Accept: application/json Apr 12 04:06:59 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 04:06:59 user devstack@n-api.service[62074]: Connection: close Apr 12 04:06:59 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 04:06:59 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 04:06:59 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 04:06:59 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 04:06:59 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNiyzt-9QbfMwH9AC49D9zISTnEgAmQHGM76vhr0lQlL8WRDTWaJ5fs-tOdIMa-a0KCI38--KsOXtvaui_EieaiIp1AG2RUqCrW-NMMZQq-xCgjuxYcerHnQzjcwwsG7WsyXoNRyRLaC073FBdNGee1zBXr-Cud8Kxh_M5P45bZ10AOQ Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Project-Id: 01223543586e474b875e7dbf2c78ef87 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Project-Name: tempest-SnapshotDataIntegrityTests-956619934 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01223543586e474b875e7dbf2c78ef87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01223543586e474b875e7dbf2c78ef87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01223543586e474b875e7dbf2c78ef87"}]}] Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Tenant: tempest-SnapshotDataIntegrityTests-956619934 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Tenant-Id: 01223543586e474b875e7dbf2c78ef87 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-956619934 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-User: tempest-SnapshotDataIntegrityTests-956619934-project-member Apr 12 04:06:59 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 04:06:59 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 04:06:59 user devstack@n-api.service[62074]: X-User-Id: dc05e2e474814697920e72d50883e263 Apr 12 04:06:59 user devstack@n-api.service[62074]: X-User-Name: tempest-SnapshotDataIntegrityTests-956619934-project-member Apr 12 04:06:59 user devstack@n-api.service[62074]: method: > Apr 12 04:06:59 user devstack@n-api.service[62074]: exception: Instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 could not be found. Apr 12 04:06:59 user devstack@n-api.service[62074]: action_args: {'id': '7a6fb26c-9c8f-4be7-b16f-8662eed2e489'} Apr 12 04:06:59 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 could not be found. Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 could not be found. Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 could not be found. Apr 12 04:06:59 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:06:59 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Returning 404 to user: Instance 7a6fb26c-9c8f-4be7-b16f-8662eed2e489 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 04:06:59 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-80539bdb-0ebc-443a-bdc9-0714ec3a48be tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489" status: 404 len: 111 microversion: 2.1 time: 0.040632 Apr 12 04:06:59 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 370/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:06:59 2023] GET /compute/v2.1/servers/7a6fb26c-9c8f-4be7-b16f-8662eed2e489 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 04:07:00 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=2 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:00 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell0:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:00 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:00 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:00 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-f4c0e9fe-64d9-4645-9f97-5faf301e2437 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] Calling method '.version_select at 0x7f76a6d908b0>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:07:00 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-f4c0e9fe-64d9-4645-9f97-5faf301e2437 tempest-SnapshotDataIntegrityTests-956619934 tempest-SnapshotDataIntegrityTests-956619934-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-272659456" status: 202 len: 0 microversion: 2.1 time: 0.029700 Apr 12 04:07:00 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 371/1112] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 04:07:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-272659456 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell0:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:07:25 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:07:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-32ef34c3-be49-45d0-9068-8b982176fe32 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1553 microversion: 2.1 time: 0.262417 Apr 12 04:07:25 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 372/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:07:25 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:08:25 user devstack@n-api.service[62074]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dcb4d780-1fb1-459e-be04-d579607464d3] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:08:25 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:08:25 user devstack@n-api.service[62074]: Wed Apr 12 04:08:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-interface (ip 10.0.0.210) !!! Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:26 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-f6897175-de7f-4271-b066-6eb1de3b3552 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.319050 Apr 12 04:08:26 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 371/1114] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 04:08:25 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-interface => generated 283 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:08:26 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64"}} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:26 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:26 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-2438f0bb-349c-484a-8e78-3182c0aee19b req-0b703007-6729-4be3-b22c-ddb11e4e1077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:08:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-2438f0bb-349c-484a-8e78-3182c0aee19b req-0b703007-6729-4be3-b22c-ddb11e4e1077 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-2438f0bb-349c-484a-8e78-3182c0aee19b req-0b703007-6729-4be3-b22c-ddb11e4e1077 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:26 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-2438f0bb-349c-484a-8e78-3182c0aee19b req-0b703007-6729-4be3-b22c-ddb11e4e1077 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-2438f0bb-349c-484a-8e78-3182c0aee19b req-0b703007-6729-4be3-b22c-ddb11e4e1077 service nova] Creating event network-changed:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:26 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-2438f0bb-349c-484a-8e78-3182c0aee19b req-0b703007-6729-4be3-b22c-ddb11e4e1077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159154 Apr 12 04:08:26 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 372/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 04:08:27 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-d7a7efda-f472-4439-8b01-3a6c788f88d2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439222 Apr 12 04:08:27 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 373/1116] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 04:08:26 2023] POST /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:33 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lazy-loading 'flavor' on Instance uuid 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:08:33 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] [dcb4d780-1fb1-459e-be04-d579607464d3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33200. Apr 12 04:08:33 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8702ab0d-84a5-42fe-9ca6-726750dda939 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/action" status: 200 len: 32 microversion: 2.1 time: 0.166097 Apr 12 04:08:33 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 372/1117] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 04:08:33 2023] POST /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:33 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:34 user devstack@n-api.service[62073]: DEBUG nova.policy [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62073) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:08:34 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-4b4d8258-37d1-48b0-a4dc-ef3c994f8ab7 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1724 microversion: 2.1 time: 0.389185 Apr 12 04:08:34 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 373/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:08:33 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:08:34 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-238daf88-f003-4867-94b4-3bb93df02c15 req-88ae907f-cce4-4003-8ac0-84cf251a0a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-unplugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:08:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-238daf88-f003-4867-94b4-3bb93df02c15 req-88ae907f-cce4-4003-8ac0-84cf251a0a48 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-238daf88-f003-4867-94b4-3bb93df02c15 req-88ae907f-cce4-4003-8ac0-84cf251a0a48 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:34 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-238daf88-f003-4867-94b4-3bb93df02c15 req-88ae907f-cce4-4003-8ac0-84cf251a0a48 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-238daf88-f003-4867-94b4-3bb93df02c15 req-88ae907f-cce4-4003-8ac0-84cf251a0a48 service nova] Creating event network-vif-unplugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:35 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-238daf88-f003-4867-94b4-3bb93df02c15 req-88ae907f-cce4-4003-8ac0-84cf251a0a48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049263 Apr 12 04:08:35 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 374/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:08:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:08:37 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-unplugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:08:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:37 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Creating event network-vif-unplugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:37 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-5f2e4c0f-d1de-4e9c-9b64-888da3f56e9b req-77dbab89-be29-45ab-8e63-376e92984c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.045948 Apr 12 04:08:37 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 373/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:08:37 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:08:39 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:08:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:08:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:08:39 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:08:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:08:39 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1513c191-7546-4888-91df-cc59457b02b5 req-faff7de5-0f98-4d1a-bf24-ddafec8ee335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036313 Apr 12 04:08:39 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 374/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:08:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:09:24 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:09:24 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-87edcc34-59f8-4b8a-99e1-23668ead321e tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1704 microversion: 2.1 time: 0.418651 Apr 12 04:09:24 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 375/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:09:24 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1704 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 while it is in vm_state rescued Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Request method failure captured: Apr 12 04:10:24 user devstack@n-api.service[62074]: request: DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments/ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64 HTTP/1.1 Apr 12 04:10:24 user devstack@n-api.service[62074]: Accept: application/json Apr 12 04:10:24 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 04:10:24 user devstack@n-api.service[62074]: Connection: close Apr 12 04:10:24 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 04:10:24 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 04:10:24 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 04:10:24 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 04:10:24 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNixNbgyTKivc6fZWz-HRQFpqAEHSiU_1M9f-xTEdO4zRmuH9O5bBX96S98UL4mcgUFvqGOVQ0787Gkk4acAPG2u4xsxNKH19R_FGY4f3KyRJqEJNNfGNBnQeom-yvkccKqmtQgh5qLXsZSmW9Yy6pbtbQNs16oFIeciP9C45MSJb7j8 Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Project-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}] Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Tenant-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:10:24 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:10:24 user devstack@n-api.service[62074]: X-User: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:10:24 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 04:10:24 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 04:10:24 user devstack@n-api.service[62074]: X-User-Id: 44a0206f1323440db4f8411a3c3c088d Apr 12 04:10:24 user devstack@n-api.service[62074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:10:24 user devstack@n-api.service[62074]: method: > Apr 12 04:10:24 user devstack@n-api.service[62074]: exception: Cannot 'detach_volume' instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 while it is in vm_state rescued Apr 12 04:10:24 user devstack@n-api.service[62074]: action_args: {'server_id': '24cfaf66-a8ca-4dc3-8b83-1fe7de583f43', 'id': 'ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64'} Apr 12 04:10:24 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 while it is in vm_state rescued Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 while it is in vm_state rescued Apr 12 04:10:24 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:10:24 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Returning 409 to user: Cannot 'detach_volume' instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 while it is in vm_state rescued {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 04:10:24 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-8de3acfb-07b0-428b-8405-f1945d3e1348 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments/ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64" status: 409 len: 152 microversion: 2.1 time: 0.131749 Apr 12 04:10:24 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 374/1123] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 04:10:24 2023] DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments/ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 04:10:24 user devstack@n-api.service[62073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:10:24 user devstack@n-api.service[62073]: Wed Apr 12 04:10:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/action (ip 10.0.0.210) !!! Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=6 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=10 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:24 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:25 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-10a577c4-9564-4e3d-9c94-51d54360e2ee tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/action" status: 202 len: 0 microversion: 2.1 time: 0.104339 Apr 12 04:10:25 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 375/1124] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 04:10:24 2023] POST /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:10:25 user devstack@n-api.service[62072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:10:25 user devstack@n-api.service[62072]: Wed Apr 12 04:10:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 (ip 10.0.0.210) !!! Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:25 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:10:25 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-564e730e-7998-4351-989c-c02145a8eede tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1712 microversion: 2.1 time: 0.188437 Apr 12 04:10:25 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 376/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:10:25 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1712 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:10:25 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-ee166af2-3da8-4425-b461-1d4d12b8ec6c req-58b54289-f28c-449f-a7d3-e08e9778ed6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-unplugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:10:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ee166af2-3da8-4425-b461-1d4d12b8ec6c req-58b54289-f28c-449f-a7d3-e08e9778ed6e service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ee166af2-3da8-4425-b461-1d4d12b8ec6c req-58b54289-f28c-449f-a7d3-e08e9778ed6e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:25 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-ee166af2-3da8-4425-b461-1d4d12b8ec6c req-58b54289-f28c-449f-a7d3-e08e9778ed6e service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-ee166af2-3da8-4425-b461-1d4d12b8ec6c req-58b54289-f28c-449f-a7d3-e08e9778ed6e service nova] Creating event network-vif-unplugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:25 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-ee166af2-3da8-4425-b461-1d4d12b8ec6c req-58b54289-f28c-449f-a7d3-e08e9778ed6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036757 Apr 12 04:10:25 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 375/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:10:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:10:27 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-unplugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:10:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:27 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Creating event network-vif-unplugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:27 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:28 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-1b379c36-b315-4421-893b-78a1692b9da9 req-7d16e2ec-0072-4547-91a1-f8148d19f528 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.037991 Apr 12 04:10:28 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 376/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:10:27 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:10:30 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-5acbe973-eb3c-4874-af11-ae76b28df6c2 req-ba34c65f-92a9-4626-9eeb-a810df7c7ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:10:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5acbe973-eb3c-4874-af11-ae76b28df6c2 req-ba34c65f-92a9-4626-9eeb-a810df7c7ea0 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:10:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5acbe973-eb3c-4874-af11-ae76b28df6c2 req-ba34c65f-92a9-4626-9eeb-a810df7c7ea0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:10:30 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5acbe973-eb3c-4874-af11-ae76b28df6c2 req-ba34c65f-92a9-4626-9eeb-a810df7c7ea0 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:10:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-5acbe973-eb3c-4874-af11-ae76b28df6c2 req-ba34c65f-92a9-4626-9eeb-a810df7c7ea0 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:10:30 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-5acbe973-eb3c-4874-af11-ae76b28df6c2 req-ba34c65f-92a9-4626-9eeb-a810df7c7ea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032577 Apr 12 04:10:30 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 377/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:10:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:11:15 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 04:11:15 user devstack@n-api.service[62074]: Wed Apr 12 04:11:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 (ip 10.0.0.210) !!! Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:11:15 user devstack@n-api.service[62074]: DEBUG nova.policy [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62074) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:11:15 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ce1743e0-c5b0-41f3-883c-9a571d6fa036 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1718 microversion: 2.1 time: 0.156513 Apr 12 04:11:15 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 376/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:11:15 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:12:15 user devstack@n-api.service[62073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:12:15 user devstack@n-api.service[62073]: Wed Apr 12 04:12:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-interface (ip 10.0.0.210) !!! Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:15 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:15 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-81e18599-9ec5-41ef-aaac-540902537e50 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.095266 Apr 12 04:12:15 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 377/1130] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 04:12:15 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-interface => generated 283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:12:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:12:16 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=8 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:12:16 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-c1947206-171a-4bc8-98bc-e0d1385f3905 req-1e6f9faa-8431-4464-bfa3-ca8ce996e7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:12:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c1947206-171a-4bc8-98bc-e0d1385f3905 req-1e6f9faa-8431-4464-bfa3-ca8ce996e7ec service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c1947206-171a-4bc8-98bc-e0d1385f3905 req-1e6f9faa-8431-4464-bfa3-ca8ce996e7ec service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:16 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-c1947206-171a-4bc8-98bc-e0d1385f3905 req-1e6f9faa-8431-4464-bfa3-ca8ce996e7ec service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-c1947206-171a-4bc8-98bc-e0d1385f3905 req-1e6f9faa-8431-4464-bfa3-ca8ce996e7ec service nova] Creating event network-changed:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:12:16 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-c1947206-171a-4bc8-98bc-e0d1385f3905 req-1e6f9faa-8431-4464-bfa3-ca8ce996e7ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118457 Apr 12 04:12:16 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 378/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:12:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=6 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:12:16 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:12:16 user devstack@n-api.service[62074]: Wed Apr 12 04:12:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments/ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64 (ip 10.0.0.210) !!! Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:16 user devstack@n-api.service[62074]: DEBUG nova.objects.instance [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lazy-loading 'services' on Instance uuid 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 {{(pid=62074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 04:12:16 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-cdf843f8-c3d3-474d-8b32-e5f8b115ca18 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments/ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64" status: 202 len: 0 microversion: 2.1 time: 0.191319 Apr 12 04:12:16 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 377/1132] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 04:12:16 2023] DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments/ccbf6a5c-bbdb-4d91-bcb3-a9963485dd64 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:16 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:17 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-ce6a739b-9473-464b-b86f-1880e39fca5a tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050905 Apr 12 04:12:17 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 378/1133] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:12:16 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:12:18 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-5f0cba19-d416-4098-ad09-57984d1c340b req-8829306a-d98d-49c6-a80e-b585dcf93a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:12:18 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5f0cba19-d416-4098-ad09-57984d1c340b req-8829306a-d98d-49c6-a80e-b585dcf93a05 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:12:18 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5f0cba19-d416-4098-ad09-57984d1c340b req-8829306a-d98d-49c6-a80e-b585dcf93a05 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:12:18 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-5f0cba19-d416-4098-ad09-57984d1c340b req-8829306a-d98d-49c6-a80e-b585dcf93a05 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:12:18 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-5f0cba19-d416-4098-ad09-57984d1c340b req-8829306a-d98d-49c6-a80e-b585dcf93a05 service nova] Creating event network-changed:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:12:18 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-5f0cba19-d416-4098-ad09-57984d1c340b req-8829306a-d98d-49c6-a80e-b585dcf93a05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031521 Apr 12 04:12:18 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 379/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:13:07 user devstack@n-api.service[62074]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dcb4d780-1fb1-459e-be04-d579607464d3] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-6acd8454-44ed-4df8-b400-95261586f98c tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065436 Apr 12 04:13:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 378/1135] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 04:13:07 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=4 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=10 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 04:13:07 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-30f1fd56-91b8-4d0a-adef-d4b0ed2a9453 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 204 len: 0 microversion: 2.1 time: 0.115966 Apr 12 04:13:07 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 379/1136] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 04:13:07 2023] DELETE /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=4 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:07 user devstack@n-api.service[62072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 04:13:07 user devstack@n-api.service[62072]: Wed Apr 12 04:13:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 (ip 10.0.0.210) !!! Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:13:07 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-45da3a4a-f342-4cba-899e-2140a52999b2 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 200 len: 1678 microversion: 2.1 time: 0.210532 Apr 12 04:13:07 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 380/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:13:07 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-34d3d376-64bf-4043-a7bb-54ffd873d69e req-51a9a703-041a-477a-afb1-a24c587794eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-unplugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-34d3d376-64bf-4043-a7bb-54ffd873d69e req-51a9a703-041a-477a-afb1-a24c587794eb service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-34d3d376-64bf-4043-a7bb-54ffd873d69e req-51a9a703-041a-477a-afb1-a24c587794eb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:07 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-34d3d376-64bf-4043-a7bb-54ffd873d69e req-51a9a703-041a-477a-afb1-a24c587794eb service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-34d3d376-64bf-4043-a7bb-54ffd873d69e req-51a9a703-041a-477a-afb1-a24c587794eb service nova] Creating event network-vif-unplugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:07 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-34d3d376-64bf-4043-a7bb-54ffd873d69e req-51a9a703-041a-477a-afb1-a24c587794eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118332 Apr 12 04:13:07 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 379/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:13:09 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-unplugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-plugged", "status": "completed", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}, {"server_uuid": "24cfaf66-a8ca-4dc3-8b83-1fe7de583f43", "name": "network-vif-deleted", "tag": "b2759903-00b2-4ce7-8693-e93f30bb850c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:13:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:09 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Creating event network-vif-unplugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Creating event network-vif-plugged:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] Creating event network-vif-deleted:b2759903-00b2-4ce7-8693-e93f30bb850c for instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 on user Apr 12 04:13:09 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-ca5a54de-b273-473f-93d4-dd155ac7a49d req-66542fc8-54c4-455b-878e-1cfa35ced382 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.038489 Apr 12 04:13:09 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 380/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a2764831-50e8-4b04-aab6-033acdba5b51] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=2 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:57 user devstack@n-api.service[62072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:13:57 user devstack@n-api.service[62072]: Wed Apr 12 04:13:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 (ip 10.0.0.210) !!! Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:13:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.wsgi [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] HTTP exception thrown: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 could not be found. Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Request method failure captured: Apr 12 04:13:57 user devstack@n-api.service[62072]: request: GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 HTTP/1.1 Apr 12 04:13:57 user devstack@n-api.service[62072]: Accept: application/json Apr 12 04:13:57 user devstack@n-api.service[62072]: Accept-Encoding: identity Apr 12 04:13:57 user devstack@n-api.service[62072]: Connection: close Apr 12 04:13:57 user devstack@n-api.service[62072]: Content-Length: 0 Apr 12 04:13:57 user devstack@n-api.service[62072]: Content-Type: application/json Apr 12 04:13:57 user devstack@n-api.service[62072]: Host: 10.0.0.210 Apr 12 04:13:57 user devstack@n-api.service[62072]: Openstack-System-Scope: None Apr 12 04:13:57 user devstack@n-api.service[62072]: User-Agent: python-urllib3/1.26.15 Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Auth-Token: gAAAAABkNixNbgyTKivc6fZWz-HRQFpqAEHSiU_1M9f-xTEdO4zRmuH9O5bBX96S98UL4mcgUFvqGOVQ0787Gkk4acAPG2u4xsxNKH19R_FGY4f3KyRJqEJNNfGNBnQeom-yvkccKqmtQgh5qLXsZSmW9Yy6pbtbQNs16oFIeciP9C45MSJb7j8 Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Domain-Id: None Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Domain-Name: None Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Identity-Status: Confirmed Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Is-Admin-Project: True Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Project-Domain-Id: default Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Project-Domain-Name: Default Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Project-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Role: reader,member Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Roles: reader,member Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}] Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Tenant-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:13:57 user devstack@n-api.service[62072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:13:57 user devstack@n-api.service[62072]: X-User: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:13:57 user devstack@n-api.service[62072]: X-User-Domain-Id: default Apr 12 04:13:57 user devstack@n-api.service[62072]: X-User-Domain-Name: Default Apr 12 04:13:57 user devstack@n-api.service[62072]: X-User-Id: 44a0206f1323440db4f8411a3c3c088d Apr 12 04:13:57 user devstack@n-api.service[62072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:13:57 user devstack@n-api.service[62072]: method: > Apr 12 04:13:57 user devstack@n-api.service[62072]: exception: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 could not be found. Apr 12 04:13:57 user devstack@n-api.service[62072]: action_args: {'id': '24cfaf66-a8ca-4dc3-8b83-1fe7de583f43'} Apr 12 04:13:57 user devstack@n-api.service[62072]: {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 could not be found. Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 could not be found. Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 could not be found. Apr 12 04:13:57 user devstack@n-api.service[62072]: ERROR nova.api.openstack.wsgi Apr 12 04:13:57 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Returning 404 to user: Instance 24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 could not be found. {{(pid=62072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 04:13:57 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-2e8dcd4d-8ccf-4c8c-b55d-043194d10584 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43" status: 404 len: 111 microversion: 2.1 time: 0.040145 Apr 12 04:13:57 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 381/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:13:57 2023] GET /compute/v2.1/servers/24cfaf66-a8ca-4dc3-8b83-1fe7de583f43 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 04:13:57 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:57 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=8 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:13:57 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-af48eeb4-75fd-4cee-bfc2-1de8242758d9 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '.version_select at 0x7f76a68b6440>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:13:57 user devstack@n-api.service[62074]: INFO oslo.messaging._drivers.impl_rabbit [-] [dcb4d780-1fb1-459e-be04-d579607464d3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43064. Apr 12 04:13:57 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-af48eeb4-75fd-4cee-bfc2-1de8242758d9 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469921698" status: 202 len: 0 microversion: 2.1 time: 0.041570 Apr 12 04:13:57 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 380/1141] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 04:13:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469921698 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:03 user devstack@n-api.service[62073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 04:14:03 user devstack@n-api.service[62073]: Wed Apr 12 04:14:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d (ip 10.0.0.210) !!! Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:03 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 04:14:03 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-a1863a4c-bcd7-4559-bb14-ff1e2e6b385d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 204 len: 0 microversion: 2.1 time: 0.132527 Apr 12 04:14:03 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 381/1142] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 04:14:03 2023] DELETE /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:03 user devstack@n-api.service[62072]: INFO oslo.messaging._drivers.impl_rabbit [-] [a2764831-50e8-4b04-aab6-033acdba5b51] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43088. Apr 12 04:14:03 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:14:03 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-66804247-6932-45e5-a56e-6f2d70203c4f tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 200 len: 1496 microversion: 2.1 time: 0.212233 Apr 12 04:14:03 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 382/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:14:03 2023] GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:14:03 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-2f2d40ec-3768-4bee-abb8-992102fdf6ac req-f8072d06-d27f-4c9f-8e5d-40cd7884d088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-unplugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:14:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2f2d40ec-3768-4bee-abb8-992102fdf6ac req-f8072d06-d27f-4c9f-8e5d-40cd7884d088 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2f2d40ec-3768-4bee-abb8-992102fdf6ac req-f8072d06-d27f-4c9f-8e5d-40cd7884d088 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:03 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-2f2d40ec-3768-4bee-abb8-992102fdf6ac req-f8072d06-d27f-4c9f-8e5d-40cd7884d088 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-2f2d40ec-3768-4bee-abb8-992102fdf6ac req-f8072d06-d27f-4c9f-8e5d-40cd7884d088 service nova] Creating event network-vif-unplugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 04:14:03 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-2f2d40ec-3768-4bee-abb8-992102fdf6ac req-f8072d06-d27f-4c9f-8e5d-40cd7884d088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028702 Apr 12 04:14:03 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 381/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:14:04 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-d8c65335-4560-4100-8f9b-2289c23823dc req-7db9a1c4-a64d-489b-b3e3-b600132bd474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-deleted", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:14:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d8c65335-4560-4100-8f9b-2289c23823dc req-7db9a1c4-a64d-489b-b3e3-b600132bd474 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d8c65335-4560-4100-8f9b-2289c23823dc req-7db9a1c4-a64d-489b-b3e3-b600132bd474 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:04 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-d8c65335-4560-4100-8f9b-2289c23823dc req-7db9a1c4-a64d-489b-b3e3-b600132bd474 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-d8c65335-4560-4100-8f9b-2289c23823dc req-7db9a1c4-a64d-489b-b3e3-b600132bd474 service nova] Creating event network-vif-deleted:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 04:14:04 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-d8c65335-4560-4100-8f9b-2289c23823dc req-7db9a1c4-a64d-489b-b3e3-b600132bd474 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039373 Apr 12 04:14:04 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 382/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:14:05 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-f141238b-8b55-4717-a161-887981b49bc3 req-4ee0df1f-8045-4873-a002-7b966e60c2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd92d70-a2af-4b2a-97c3-2981c157278d", "name": "network-vif-plugged", "status": "completed", "tag": "ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:14:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-f141238b-8b55-4717-a161-887981b49bc3 req-4ee0df1f-8045-4873-a002-7b966e60c2f4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-f141238b-8b55-4717-a161-887981b49bc3 req-4ee0df1f-8045-4873-a002-7b966e60c2f4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:05 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-f141238b-8b55-4717-a161-887981b49bc3 req-4ee0df1f-8045-4873-a002-7b966e60c2f4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-f141238b-8b55-4717-a161-887981b49bc3 req-4ee0df1f-8045-4873-a002-7b966e60c2f4 service nova] Creating event network-vif-plugged:ee1cfaf9-15e5-43a6-854d-4fd6f4b59bda for instance 6cd92d70-a2af-4b2a-97c3-2981c157278d on user Apr 12 04:14:05 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-f141238b-8b55-4717-a161-887981b49bc3 req-4ee0df1f-8045-4873-a002-7b966e60c2f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035064 Apr 12 04:14:05 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 383/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=2 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: 6cd92d70-a2af-4b2a-97c3-2981c157278d] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] HTTP exception thrown: Instance 6cd92d70-a2af-4b2a-97c3-2981c157278d could not be found. Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Request method failure captured: Apr 12 04:14:53 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d HTTP/1.1 Apr 12 04:14:53 user devstack@n-api.service[62074]: Accept: application/json Apr 12 04:14:53 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 04:14:53 user devstack@n-api.service[62074]: Connection: close Apr 12 04:14:53 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 04:14:53 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 04:14:53 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 04:14:53 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 04:14:53 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNixNbgyTKivc6fZWz-HRQFpqAEHSiU_1M9f-xTEdO4zRmuH9O5bBX96S98UL4mcgUFvqGOVQ0787Gkk4acAPG2u4xsxNKH19R_FGY4f3KyRJqEJNNfGNBnQeom-yvkccKqmtQgh5qLXsZSmW9Yy6pbtbQNs16oFIeciP9C45MSJb7j8 Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Project-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}] Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Tenant-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:14:53 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:14:53 user devstack@n-api.service[62074]: X-User: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:14:53 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 04:14:53 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 04:14:53 user devstack@n-api.service[62074]: X-User-Id: 44a0206f1323440db4f8411a3c3c088d Apr 12 04:14:53 user devstack@n-api.service[62074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:14:53 user devstack@n-api.service[62074]: method: > Apr 12 04:14:53 user devstack@n-api.service[62074]: exception: Instance 6cd92d70-a2af-4b2a-97c3-2981c157278d could not be found. Apr 12 04:14:53 user devstack@n-api.service[62074]: action_args: {'id': '6cd92d70-a2af-4b2a-97c3-2981c157278d'} Apr 12 04:14:53 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd92d70-a2af-4b2a-97c3-2981c157278d could not be found. Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd92d70-a2af-4b2a-97c3-2981c157278d could not be found. Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd92d70-a2af-4b2a-97c3-2981c157278d could not be found. Apr 12 04:14:53 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:14:53 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Returning 404 to user: Instance 6cd92d70-a2af-4b2a-97c3-2981c157278d could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 04:14:53 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-ad63b5cc-5d9e-441f-9326-9c2f524ab7df tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d" status: 404 len: 111 microversion: 2.1 time: 0.134183 Apr 12 04:14:53 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 382/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:14:53 2023] GET /compute/v2.1/servers/6cd92d70-a2af-4b2a-97c3-2981c157278d => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG dbcounter [-] [62073] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62073) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62073) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:53 user devstack@n-api.service[62073]: DEBUG nova.compute.api [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Going to try to terminate instance {{(pid=62073) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 04:14:53 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [None req-71a57010-2728-4a0b-b094-2ece3625e2d4 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 204 len: 0 microversion: 2.1 time: 0.121710 Apr 12 04:14:53 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 383/1148] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 04:14:53 2023] DELETE /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_api:SELECT=6 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG dbcounter [-] [62072] Writing DB stats nova_cell1:SELECT=10 {{(pid=62072) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG nova.compute.api [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62072) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:53 user devstack@n-api.service[62072]: DEBUG nova.policy [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a0206f1323440db4f8411a3c3c088d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a8a4f5d59e479f9ca7b73a9e270c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62072) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 04:14:53 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [None req-179f6c37-878a-4cb0-bcbb-dd11a1f58fe8 tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 200 len: 1510 microversion: 2.1 time: 0.243916 Apr 12 04:14:53 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 384/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:14:53 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 04:14:54 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [req-b34cb142-6513-4d5c-9f96-1ba9d5eea10d req-9a00826a-fb7a-4c28-b372-49309522a8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-unplugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:14:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b34cb142-6513-4d5c-9f96-1ba9d5eea10d req-9a00826a-fb7a-4c28-b372-49309522a8d4 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b34cb142-6513-4d5c-9f96-1ba9d5eea10d req-9a00826a-fb7a-4c28-b372-49309522a8d4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:54 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [req-b34cb142-6513-4d5c-9f96-1ba9d5eea10d req-9a00826a-fb7a-4c28-b372-49309522a8d4 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.compute.server_external_events [req-b34cb142-6513-4d5c-9f96-1ba9d5eea10d req-9a00826a-fb7a-4c28-b372-49309522a8d4 service nova] Creating event network-vif-unplugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:14:54 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [req-b34cb142-6513-4d5c-9f96-1ba9d5eea10d req-9a00826a-fb7a-4c28-b372-49309522a8d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107208 Apr 12 04:14:54 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 383/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:14:54 user devstack@n-api.service[62073]: DEBUG nova.api.openstack.wsgi [req-c5d24006-104c-4013-8cd8-1c5236fa287b req-22df1883-b05a-465e-83fd-f40d9f068cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-deleted", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:14:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c5d24006-104c-4013-8cd8-1c5236fa287b req-22df1883-b05a-465e-83fd-f40d9f068cd7 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c5d24006-104c-4013-8cd8-1c5236fa287b req-22df1883-b05a-465e-83fd-f40d9f068cd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:54 user devstack@n-api.service[62073]: DEBUG oslo_concurrency.lockutils [req-c5d24006-104c-4013-8cd8-1c5236fa287b req-22df1883-b05a-465e-83fd-f40d9f068cd7 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62073) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.compute.server_external_events [req-c5d24006-104c-4013-8cd8-1c5236fa287b req-22df1883-b05a-465e-83fd-f40d9f068cd7 service nova] Creating event network-vif-deleted:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:14:54 user devstack@n-api.service[62073]: INFO nova.api.openstack.requestlog [req-c5d24006-104c-4013-8cd8-1c5236fa287b req-22df1883-b05a-465e-83fd-f40d9f068cd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029743 Apr 12 04:14:54 user devstack@n-api.service[62073]: [pid: 62073|app: 0|req: 384/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:14:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:14:56 user devstack@n-api.service[62072]: DEBUG nova.api.openstack.wsgi [req-17ee8aeb-3bcf-4379-93ce-99584c9e902e req-b473f44d-c3dc-4566-85a3-9ed9bddac108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40e137-84e3-4d85-895b-1f6da2673457", "name": "network-vif-plugged", "status": "completed", "tag": "16a3f234-3d0d-446c-b6a0-0a240e35aa6c"}]} {{(pid=62072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 04:14:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-17ee8aeb-3bcf-4379-93ce-99584c9e902e req-b473f44d-c3dc-4566-85a3-9ed9bddac108 service nova] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:14:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-17ee8aeb-3bcf-4379-93ce-99584c9e902e req-b473f44d-c3dc-4566-85a3-9ed9bddac108 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:14:56 user devstack@n-api.service[62072]: DEBUG oslo_concurrency.lockutils [req-17ee8aeb-3bcf-4379-93ce-99584c9e902e req-b473f44d-c3dc-4566-85a3-9ed9bddac108 service nova] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62072) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:14:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.compute.server_external_events [req-17ee8aeb-3bcf-4379-93ce-99584c9e902e req-b473f44d-c3dc-4566-85a3-9ed9bddac108 service nova] Creating event network-vif-plugged:16a3f234-3d0d-446c-b6a0-0a240e35aa6c for instance de40e137-84e3-4d85-895b-1f6da2673457 on user Apr 12 04:14:56 user devstack@n-api.service[62072]: INFO nova.api.openstack.requestlog [req-17ee8aeb-3bcf-4379-93ce-99584c9e902e req-b473f44d-c3dc-4566-85a3-9ed9bddac108 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029299 Apr 12 04:14:56 user devstack@n-api.service[62072]: [pid: 62072|app: 0|req: 385/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 04:14:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 04:15:43 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_api:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG dbcounter [-] [62074] Writing DB stats nova_cell1:SELECT=4 {{(pid=62074) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Calling method '>' {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG nova.compute.api [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] [instance: de40e137-84e3-4d85-895b-1f6da2673457] Fetching instance by UUID {{(pid=62074) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Acquiring lock "5d3401a5-2c95-4968-95ab-b3db72009879" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG oslo_concurrency.lockutils [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Lock "5d3401a5-2c95-4968-95ab-b3db72009879" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62074) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 04:15:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.wsgi [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] HTTP exception thrown: Instance de40e137-84e3-4d85-895b-1f6da2673457 could not be found. Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Request method failure captured: Apr 12 04:15:44 user devstack@n-api.service[62074]: request: GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 HTTP/1.1 Apr 12 04:15:44 user devstack@n-api.service[62074]: Accept: application/json Apr 12 04:15:44 user devstack@n-api.service[62074]: Accept-Encoding: identity Apr 12 04:15:44 user devstack@n-api.service[62074]: Connection: close Apr 12 04:15:44 user devstack@n-api.service[62074]: Content-Length: 0 Apr 12 04:15:44 user devstack@n-api.service[62074]: Content-Type: application/json Apr 12 04:15:44 user devstack@n-api.service[62074]: Host: 10.0.0.210 Apr 12 04:15:44 user devstack@n-api.service[62074]: Openstack-System-Scope: None Apr 12 04:15:44 user devstack@n-api.service[62074]: User-Agent: python-urllib3/1.26.15 Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Auth-Token: gAAAAABkNixNbgyTKivc6fZWz-HRQFpqAEHSiU_1M9f-xTEdO4zRmuH9O5bBX96S98UL4mcgUFvqGOVQ0787Gkk4acAPG2u4xsxNKH19R_FGY4f3KyRJqEJNNfGNBnQeom-yvkccKqmtQgh5qLXsZSmW9Yy6pbtbQNs16oFIeciP9C45MSJb7j8 Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Domain-Id: None Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Domain-Name: None Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Identity-Status: Confirmed Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Is-Admin-Project: True Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Project-Domain-Id: default Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Project-Domain-Name: Default Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Project-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Role: reader,member Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Roles: reader,member Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6a8a4f5d59e479f9ca7b73a9e270c4b"}]}] Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Tenant-Id: a6a8a4f5d59e479f9ca7b73a9e270c4b Apr 12 04:15:44 user devstack@n-api.service[62074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-529226261 Apr 12 04:15:44 user devstack@n-api.service[62074]: X-User: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:15:44 user devstack@n-api.service[62074]: X-User-Domain-Id: default Apr 12 04:15:44 user devstack@n-api.service[62074]: X-User-Domain-Name: Default Apr 12 04:15:44 user devstack@n-api.service[62074]: X-User-Id: 44a0206f1323440db4f8411a3c3c088d Apr 12 04:15:44 user devstack@n-api.service[62074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-529226261-project-member Apr 12 04:15:44 user devstack@n-api.service[62074]: method: > Apr 12 04:15:44 user devstack@n-api.service[62074]: exception: Instance de40e137-84e3-4d85-895b-1f6da2673457 could not be found. Apr 12 04:15:44 user devstack@n-api.service[62074]: action_args: {'id': 'de40e137-84e3-4d85-895b-1f6da2673457'} Apr 12 04:15:44 user devstack@n-api.service[62074]: {{(pid=62074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de40e137-84e3-4d85-895b-1f6da2673457 could not be found. Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de40e137-84e3-4d85-895b-1f6da2673457 could not be found. Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de40e137-84e3-4d85-895b-1f6da2673457 could not be found. Apr 12 04:15:44 user devstack@n-api.service[62074]: ERROR nova.api.openstack.wsgi Apr 12 04:15:44 user devstack@n-api.service[62074]: DEBUG nova.api.openstack.wsgi [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] Returning 404 to user: Instance de40e137-84e3-4d85-895b-1f6da2673457 could not be found. {{(pid=62074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 04:15:44 user devstack@n-api.service[62074]: INFO nova.api.openstack.requestlog [None req-06d579cd-f018-45c0-aa29-e8e90cc0fa5d tempest-ServerRescueNegativeTestJSON-529226261 tempest-ServerRescueNegativeTestJSON-529226261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457" status: 404 len: 111 microversion: 2.1 time: 0.045842 Apr 12 04:15:44 user devstack@n-api.service[62074]: [pid: 62074|app: 0|req: 384/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 04:15:43 2023] GET /compute/v2.1/servers/de40e137-84e3-4d85-895b-1f6da2673457 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)